“Calhoun 


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1973-03 


Problems in investigation theory 


Balut, Stephen John 


Monterey, California. Naval Postgraduate School 
http://ndl.handle.net/10945/16756 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


: Calhoun is the Naval Postgraduate School's public access digital repository for 
/ (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist : Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed — and published — scholarly author. 


LIBRARY Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 


PROBLEMS IN INVESTIGATION THEORY 


Stephen John Balut 











THESIS 


PROBLEMS IN INVESTIGATION THEORY 


by 
stephen John Balut 


Thesis Advisor: Ee HOw 
Marech 1973 


Approved for public release; distribution unlincted. 


115 3372 





Problems in Investigation Theory 


by 


Stephen John Balut 
Lieutenant Commander, United States Navy 
B.A., Kings College, 1960 


Submitted in partial fulfillment of the 
requirements for the degree of 


DOCTOR OF PHILOSOPHY 
from the 


NAVAL POSTGRADUATE SCHOOL 


1 10A79 





Library 
Naval Postgradu 


Monterey, Cal ate Schoo! 


fornia fe 2 
ABSTRACT 


Investigation theory treats discrete combinatorial opti- 
mization problems in which there are several objects passing 
through a region containing one or more investigators who 
are to investigate, according to some criteria, objects 
prior to their escape across a portion of the boundary of 
the region. In general, investigation times are sequence- 
dependent functions of the time iiVvesuioapton 15 Lnablaved. 
This research treats problems with one investigator under the 
criteria of minimization of the number of objects to escape 
Meenvestigsaved. Those problems for which optimal solutions 
can be efficiently obtained are identified and algorithms 
developed. For the general problem, heuristic solurtien 
methods are suggested and evaluated through comparison of 
results obtained with optimal solutions. An analysis is 
presented for problems with uncertain investigation times and 
also for problems in which objects are not immediately avail- 
able for investigation. Generalizations to more than one 
investigator ana an alternate objective are discussed. the 
relationship between investigation and Joushop scheduling 


problems is illustrated throughout. 
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I. INTRODUCTION TO INVESTIGATION THEORY 


A. INTRODUCTION 

This research deals with problems in an area called 
Investigation Theory [Refs. 8, 36]. In these problems, an 
investigator and several emi cesumeo ed targets, are located 
in a region and some of PAE tearpets ake proceeding toward a 
border of the region. ‘The ics een Ome oe LO investigate 
targets prior to their crossing the border in order to 
Seprmize with respect to some prescribed objective. 

Apart from the obsective, such problems resemble ane 
traveling salesman problem and certain classes of job-shop 
scheduling problems. However, the feature of investigation 
problems which sets them apart from other classes of problems 
appearing in the literature is the criteria of optimization. 
Although many specific eriteria can be developed, all are 
concerned with completing investigations prior to ae Bee 
escape across the border. This research represents an 
analysis of investigation problems under the objective of 
minimization of the number of targets to escape across the 
border uninvestigated. 

The author was introduced to imvece car lon Tneory while 
attached to the Operations Fvaluation Group at the Center 
for Naval Analysis. AS a result of analysis of several on- 
going military operations, a deficiency in existing theory 


was recognized. The particular problem which illuminated 





this deficiency was related to the Markettime operation 
which was being conducted along the coast of South Vietnam. 

In the early stages of the Vietnam conflict a principal 
means of logistic support for the guerilla forces operating 
in South Vietnam was via the sea. Ships of various sizes 
would rendezvous at predetermined locations on the beaches 
and offload needed supplies and food. In an effort to sever 
or at least curtail this source of supply, South Vietnamese 
and allied forces divided the coastal waters into regions and 
assigned patrol craft to each region. The search of coastal 
waters was conducted primarily Ceener seen and detected 
surface craft were intercepted and inspected by surface 
macrol crait. 

Procedures for carrying out the air search for possible 
infiltrators were quickly obtained through application OF 
methods previously developed and embodied in the theory of 
search and detection. The responsibility for investigating 
those surface craft detected to determine whether they were 
carriers of enemy supplies rested with the surface paurol 
craft assigned to the regions. In many instances the number 
of contacts to be investigated exceeded the capabilities of 
the surface patrol craft. Since there did not exist a 
unified body of knowledge interfacing with and complement ing 
the theory of search and detection for use in developing 
procedures for the patrol craft commanders to follow in such 
Sueuacions, they simply sed their best judgement in 


attempting to carry out their assigned missions. 





Analysts considering this problem found themselves 
Pee CO Specity optimal policies for conducting such 
mmmestigations, and in fact, were not even able to suggest 
one usable rule of thumb which was known to be good. 

MmiecOriizane this deficieney, Dr. J. A. Nevendorffer 
submitted a request for analysis [Ref. 8 ] in which he used 
the term “investigation problem" to describe such situations 
omemouobed that body of knowledge to be developed to treat 
meemeas investigation Theory." Except for a literature 
search [Ref. 36], apparently no research was directed toward 
Seomarea Until 19/0 when the research being reported here 
was begun. 

Mitomiescarchn Goes not tréav any problem related to the 
Serelopment Of sets of strategies for use by opposing forces, 
Memever, the results obtained would jar ape be of use fo 


eae theorists in any such endeavor. 


Pec URRENT RESEARCH RELATED TO INVESTIGATION THEORY 

The investigation Dreblem was d2dentifieq and the term 
Wanvestigation theory" defined in Ref. 8 . Literature 
searches for related research are contained in Refs. 35 
and 36. 

In Ref. 8 it is suggested that the development of 
investigation theory should begin through consideration of 
problems in which all targets have speed zero. The similar- 
ity between such problems and the traveling salesman problem 
SUeeesevcanapplication of existing solution methods for the 


s 





— 


itjeeer problem. The first solution method designed specif- 
meeeiyetor an investigation problem 1s presented in Ref. 35, 
ieee the zero target speed problem is solved using a 
memwrweavlon of the branch and bound algorithm of Little, 

et al. [Ref. 27]. 

Pee ton methods developed for various types of target 
Hommom are contained in Refs. 1, 2 , 35, and 41, all of 
Wee are incorporated into this dissertation. 

mac anvestigation problem treated here is closely related 
memes OLSnNOop scheduling problem in which the objective is 
Pammeiini2e the number of late jobs. This problem is de- 
scribed by letting Py be the eombined set-up and processing 
iene tor job i and dq. CaewOve— dave em Let acc1Ssleon Variables 


meee jOD 1 1S included in the schedule and 0 otherwise, 


a 


mere |,2,...,n. The problem is to 


ial 
Measclmsze ye x. 

aL 
Emp ject CoO Dd 0428 es er: AS toe Oe eee als 


For the case where the combined set-up and processing 
times are deterministic and sequence independent, Jackson [38] 
proves the existence of an optimal schedule in which all 
Herts are ordered according to non-decreasing due-dates. In 
Ref. 32 a very simple algorithm for obtaining optimal solutions 


for this problem is presented. Problems in which set-up or 


110 





Meeeeosi ing times are sequence dependent are usually formulated 
as traveling salesman problems [Ref. 12]. 

feravine solution techniques for the traveling salesman 
problem are summarized in Ref. 4 , in which, after an analysis 
of computational results, Hom Cocemmenadca ounae cynamic 
programming [Ref. 21] be used for problems with 13 cities 
or less, and that branch and bound [Ref. 38] be used for 
the rest. A rather complete survey of branch and bound 
methods is contained in Ref. 26. Several applications of 
imeemoranen and bound technigue to scheduling problems are 
Bemeained in Refs. 5, 22, 27, and 31. 

Meer references are cited throughout the dissertation 
comeceeir relation to the investigation problem becomes 


emoparernt. 


C. RESEARCH OBJECTIVES 

mige broad objective of this research is an analysis of 
Mesa fation problems with one investigator in which the 
objective is minimization of the number of targets to escape 
Mme stipaced, with peneralization, where possible, to 
metaved problems. Mien prince male coal tas been the develop— 
eer ot practical techniques for obtaining optimal or near 
Seema l Solutions to the class of problems described, while 
meee Same time developing a theoretical framework for 
understanding more general problems. 

WieG@iitemeuyjeecr ves anelude the following: 

Peo eeryce phe class of problems, identifying those 


for which optimal solutions can be obtained relatively easily 


LL 





memoauen Cxploiltation of special structure, and develop 
efficient algorithms for obtaining these optimal solutions. 

oe. For those problems whose structure does not lend 
feet LO SOlution methods efficient enough for practical 
ise, evaluate INS Pies Swile fro llbigskers ilsielaeretss 

3. Determine the most general class of problems for 
which solutions can be expected to be obtained. 

4, Provide a theoretical basis for extending this 
Mmetssechroush analysis of problem structure. 

pee Develop an algorithm for obtaining optimal solutions 
memune MOSt penéeral problem treated in support of objectives 
Peenrourgh 4. 

It is hoped that the results obtained in this research 
will provide others with a foundation Upon whiten Go buaid 
a unified theory of investigation. 

The results obtained are reported in the sections which 
peomrow. In Section JI a mathematical description of the 
Mimceragacion problem is presented, followed by a discussion 
Gut algests! analytical characteristics and the relative merit 
of possible approaches. Section III identifies a class of 
problems with special structure for which optimal solution 
methods have been developed. Section IV deals with those 
meaoolems for which methods yielding optimal solutions are 
computationally impractical. Methods of development and 
evaluation of heuristic solution techniques are suggested 
and illustrated by example. The algorithm developed in 


TMinegueOlsop|eeuave 5 is presented with sufficient 


We 





description to be of use to others who may wish to evaluate 
new or aiternate non-optimal solution methods. Section V 
G@iascusses the implications of uncertain investigation times 
and identifies a special class of problems for which an 
extremely efficient optimal solution method has been devel- 
wed Lt oe€ction VI, probDlems in which all targets are not 
mimearavely available for investigation are considered. 
pereeton Vil discusses generalizations of the problem and 
miem@eapplicability, and Suggests possible avenues for future 


research. 


3 





Mee PROBLEM DESCRIPTION 


Pee GENERAL DESCRIPTION 

Mmenvestipavion problem 1S one in which there are 
Several targets passing through a region containing a 
distinguished object, called the investigator, who is to 
Mmibencigave, according to some criteria, the targets prior 
tO their escape across a portion of the boundary of the 
Gamem, Called the border. An optimal solution to such a 
Meebtem 1S the specification of which targets will be 
Mmeeouaeaved, and in what Sequence, in order to optimize 
Peer respect to this criteria. 

ieetseassumed that the following information is either 
wnplted or specified in an investigation problem formulation. 


ive Lhe meaning of Investigation. 


meine region in which targets are located and the 
Suomerpion bO which the motion of the investigator 
momresuriccoed. 


wees mOblon characteristics of the investigator 
and targets. 


4, The criteria or objective of the investigator. 
POomerliiisurayvton, consider the example Situation depicted 
iierieure 2.1. The region where the targets and investigator 
are located is planar and the investigator is restricted 
Memremaln in the square Subregion. Target locations are 
Baaoreseieea oy numbered dots and their motion by vectors 
emanating from their locations. The Investigator is in 
Peosctutom 1. Suppose an investigation is considered ‘complete 


when the location of a target is reached by the investigator 


14 





= 





border 


Figure 2.l 


and let the objective be minimization of the number of 
Gargets to cross the border uninvestigated. An optimal 
solution is a path for the investigator to follow which 


contains the greatest number of targets. 


B. MATHEMATICAL DESCRIPTION 

ne investigator is always designated as target number 
one. “A solution to an investigation problem is represented 
by a Beenupacion of target numbers indicating an order in 
which targets included are investigated. Square biacieels 
are used to denote position in sequence in a permutation, 
thus the symbol [il] represents the target number which is in 
the qe position in sequence in some permutation. 

The following notation is used. Let 


1 = (1, To oeee Ty) be a permutation of m elements from 
the set {1,2,...,n}, m <n, representing an order 


In which Gargevs T,5%55+++s7), are investigated. 


- Oe atl baa 








tl 


ti 


CiewesiminMesterimne 2t whieh target 1 1s available 


POW rnVves tl GauLon for 1=25... ,n. 


the escape time of target i if not investigated 
M@tme— 2 5 61550) 
the time required to investigate the i targets 


Ty, oTo aero» i olaGweorder. 


Uhiecwitme required Lo investigate tarcet j given 


Chav investigation of target 1 is complete at 


cme t. 
07} =. 30, Then 
j=i-1 
: ry : 
Bray” gE Pesen3**gy’ 


iam bry 4a] < ars} > then Tra qftpa_a 7? includes a 


delay in the commencement of investigation of target i due 


Wemrces nonavailability at time eta 


Until generalizations are presented in Section VII, th 


momecuive considered exclusively is that of minimizing the 
number of targets to escape uninvestigated, which is equiva- 
fae FO maximizing the number of elements in the solution 
Bemmucation Tt. The latter form is used and described by 
defining |7| as the number of elements in 7, and the problem 


thus is to determine 7 which will 


16 





maximize | | 


S.U. 
oer CO] eee ea (2-1) 


Constraints (2-1) require that the investigation of 
Pemeimecarcsel Contained in 7 be completed prior to its 


escape. 
n-1 
In an n target problem there are 2 
m= 1 
Pwertons, the investigator always being designated as 


Coa 


m! possible 
m 


Mmeoey number one. Whe set of feasible solutions consists 
of all wt for which constraints (2-1) are satisfied. Note 
ieee an nm target problem contains a m(P™*)m! ONgheeieeabae is 
; m=1 

ee DISCUSSION 

The fundamental nature of Investigation problems is 
fae Of ODLIimization over a discrete set, identifying them 
menee problems in discrete mathematics. Unfortunately, 
there does not exist a unified theory of discrete mathematical 
optimization [Ref.37}]. Investigation problems are thus 
g@eéfined and treated as a special case. 

The meaning of "investigation" is left undefined in 
Pemeral and is made a requirement of the particular problem 
Hoamulagtom, bUL 1S intended to be an action carried out by 


Mie @Mivestifavor, with respect to a target, wnich is 


desirable for some reason. 
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Minecm Applicable, investigation times include the time 
foememy travel required in the conduct of the investigation. 
It can thus be seen that these times may be sequence depen- 
Semumtunctions of the time investigation is initiated. In 
a job shop context, this corresponds to combined set-up 
and processing times which are both sequence dependent and 
functions of start times. The existence of just sequence 
dependence very seriously complicates the problem as evi- 
denced by the great interest in and difficulty associated 
teem OOLaInNing solutions for the traveling salesman problem. 
meerear deal of theory has been and continues to be developed 
mime wopory Of the search for an efficient, direct solution 
feoomigue 10r the traveling salesman problem, and one might 
Suspect that these ideas would be useful in solving investi- 
gation problems. Although existing traveling salesman 
theorems [Ref. 4 ] reveal characteristics of optimal solutions 
for that problem, they do not even apply to solutions for 
investigation problems due to the movement of targets from 
(@etr initial locations and the criteria of optimization. 
weeeoe Ss Lllustrated through consideration of several theorems 
presented by Barachet and Flood [{Refs. 3 and 17] and 
discussed by Bellmore and Nemhauser [Ref. 4 ]. 

Theorem 2 of Ref. U states that under the Euclidean 
distance measure, there exists an optimal traveling salesman 
UoumeaviteheWill mol Gross itselrT. The Euclidean measure is 
ellearly applicable in Investigation problems, yet this 


theorem iS not, as illustrated by the following example 


as 














shown in Figure 2.2. Let the problem situation be that 
Gescribed for the example of Figure 2.1 with all targets 
moving directly toward the border at the same speed. Let 
the investigator's maximum speed be the same as the target's. 
mmemeaolted path is clearly optimal since it is the only 
Peasaole path containing all targets, yet the path crosses 


miece lf. 





ial fen bhiatss fae 


iicerenmauot nef. w4 states that if G is the convex 
Melb woOmecoreels in two-dimensional Euclidean space, then 
there exists an optimal tour in which the relative order of 


MiempOoMmpe Om the boundary of the convex hull is preserved. 


dee, 








tema the Same Example situation with initial positions as 
shown in Figure 2.3, the dotted path again is the only 
feasoble path containing all targets, yet the relative order 


Seempoincs on the convex huil is not preserved. 


5 
MG 
Lo 
Us ‘ 
5 
t 3 
t o fe. 
a 
ae 
ie 1¢ et 
vy LG ee SS ee ue me 
Pioure-c. 5 


The complete constraint set for a problem is represented 
implicitly by constraints (2-1) because the ume m("~* ym! 
eonstraints are too numerous to be ai ed’ Mong 
example, in a problem with the investigator and only ten 
targets, this number is 88,776,910. 

(The inveger nature of the variables suggests that integer 


programming is an appropriate approach to optimization, and, 
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feeeee sui ticient ingenuity, most problems treated to date 
Mave such a formulation. Unfortunately, almost all of these 
formulations are of negligible computational interest due 
memene enormous number of constraints. An exception will 

be presented in Section V. 

One of the objectives of this research is to obtain 
@eermal Solutions to investigation problems for use in 
ee@aeysis of problem structure and also in the development 
Seeeercactvical heuristic solution methods. It was thus 
Memeocscary Lo develop an algorithm for obtaining optimal 
Some Ons . 

fide only problem other than the traveling salesman 
problem bearing a resemblance to the investigation problem 
fomen 15 treated to any extent in the literature is the job- 
Paemmoccieauling problem with due-dates and sequence dependent 
set-up times. Even then the resemblance is restricted to 
Temmerom and constraint sets in that the criteria of 
optimization, "minimize the number of late jobs," remains 
essentially untreated. The problem considered by Moore and 
memes. fRefs. 1 , 13, 30, and 32] uses this criteria, but 
Migeecessing times are sequence independent. It is argued 
tmat problems with this structure are best treated through 
application of combinatorial programming techniques [Ref. 16]. 
It was thus decided to develop a branch and bound algorithm 
for obtaining the needed optimal solutions to the general 


Peep lemepresented in Section II,B. 


eal 





D. SUMMARY OF PROBLEM TREATMENT 

Mmmeccelons Ill through VI the problem of Section I1,B 
is considered as follows. 

peetiton Ill Creats investigation problems in which a 
known ordering is imposed on the set of all feasible solu- 
fmeemc. ihis class of problems is shown to be efficiently 
memvead through a dynamic programming formulation. It is 
shown that even more efficient methods are possible through 
fiemoeveloopment Of a Simple matrix algorithm for a certain 
subproblem. 

immo cecrlecuely, the general problem of Section I1,B 
is analyzed. Optimal solutions to randomly generated sample 
problems are used to illustrate how heuristic solution 
methods can be developed and evaluated. The algorithm 
Meee, tO Obtain the optimal solutions is presented and 
Mmemiseraced by application to a particular problem formu- 
miren. Ihe most general problem which can be expsocted tx 
be solved using the aleorichm tS .1Gentitfred- in terms of) 
meeeeo and investigator motion characteristics. 

In Section Verne wmOetMoneO! URCeCruaImty 15 introduced 
Mmeenen consideration of the problem in which sequence 
independent investigation times are known only in proba- 
mebity distributions. The sequence independence feature 
allows an integer programming formulation in which the 
Pembereet constraints is not prohibitive. It is illustrated 


that when such formulations are possible, the chance constraint 


ee 





mMeem@iique of Charnes and Cooper may be applicable. A very 
Seereient algorithm which 1s proved to produce optimal 
eemmorons for this formulation is presented. 

In Section VI problems in which targets are not avail- 
eere at problem time zero are analyzed. Theorems are 
G@eveloped and used in the construction of direct solution 
methods for several types of problems, and in the development 
memsronificant accelerations for combinatorial approaches. 

Section VII contains a discussion of several generali- 
Peed CTO cvne problem, not within the scope of this 
Mmeeearch, which appear to be promising prospects for future 


research. 


ap 





Te Ss eECIPIED ORDERING 


A. PRELIMINARY REMARKS 

A group of problems which can be efficiently solved 
includes those for which all targets are available at time 
zero and a known ordering is imposed on the set of all 


aoremerons. This corresponds to having a solution space 


i=n-l 
eontaining only the f oom) subpermutations of a 
i=l] 
single permutation 1, i.e., all subsets of elements {7,,+. 7} 


Sraeered 2S int. The number of constraints on such a problem 
i=n-l 
is thus reduced to D (SREY Cos ae 
ial 
the known ordering, corresponding to the order in which 
Meemees appear in 71, Can arise in a variety of ways. For 
example, in the case where investigator's motion is restricted 
to the border, either investigations are performed in the 
order in which targets reach the border, (escape time order), 
memos at all. Jobshop scheduling problems with scheduling 
gucci plines imposed which are formulated as investigation 
peootems also have this characteristic in that all optimal 
sehnedules wate conform to the order specified by the disci- 
paeeie. AS an example, the first-come, first-served discipline 
eorresponds to investigating targets in the order in which 
they arrive in the region. (Note also that the escape time 
order corresponds to the due-date order.) 


If such an ordering exists, combinatorial complications 


are greatly reduced. This is seen by recognizing that the 


au 











decision problem reduces to excluding the minimum number of 
ieerces trom 1 in order to produce feasibility, and that 
Wmemocearch lor the optimum is guided by the known ordering. 

Many potential applications of the results obtained for 
this problem are known, including: the defense of a coast- 
megemirom infiltracors as discussed in Section [I, point and 
area defense problems, and submarine barrier problems. 

One methodology which can be used to solve such problems 
(see Ref. 2) is Seen Pirocraningemwace 1 llustraved im the 
memrowing Section. Even more efficient methods are possible 


momespecial cases, as shown in Section III,C. 


B. DYNAMIC PROGRAMMING FORMULATION AND SOLUTION OF 

PROBLEMS HAVING A SPECIFIED ORDERING 

Wemclarity presentation and aid in understanding, the 
aac programming formulation is described in terms of a 
Semipuitied version of the problem in which all targets hav 
the same motion directly toward the border at the same sper 3d, 
and the Toei eator iserequired to remain on the border, 
(thus specifying an escape time order). Investigations are 
considered complete when the position of the target is 
meachned. This version is easily solved using a graphical 
technique guided by the dynamic programming principle of 
optimality. Afterwards, generalizations are presented which 
consider problems with more than one investigator, and 
specification of arbitrary orderings on solutions is allowed. 


Further generalizations include arbitrary courses and speeds 


ae 





Bemcoe Cargets, alternate meanings of investigation, and 


Gi ferent objectives. 


l. Dynamic Programming Formulation of Problems With 
Oem Vesti waver on the Border 


In the problem being considered there are n targets 
Meeabed in a rectangular region with initial locations 
given as (X, 5 y;) (OC. ene oCe eri eure 3.1. Inter— 
val [0,R] of the x-axis is the border of the region and all 
targets are proceeding directly toward the border at speed 
So: Initially the investigator is required to remain on 
meemoerder. His objective is to investigate as many targets 
memeeositble as they reach the border. The investigator has 
maximum speed Sy ane Came reversccuamrectLon instantaneously. 

This problem is formulated as ann stage dynamic 
programming problem [Ref. 33], as follows. Order and index 
mieecarsets according to decreasing Gaistance from the border: 
moon all Cargets with equal CiGtateecmuie same ndex.. ev 
meee) correspond Co the time target jt+l arrives at the 
DoOrder. Stage n is thus the beginning of the problem. The 
state variable x, Petr eschivosmelic POSatiOnewo: the investigator 
on the border at stage j, and f(x.) is the maximum number of 
targets which can be investigated prior to escape from among 
meets 1,...,J3, given state X,. Die eCecrs en d, atu stage 4 
15 to move along the border from x, to ee The return at 
each stage, ri (X.,d,), equals one if target j is investigated 
emee Zero (OLmMerwise. 

Let e, be the time target j reaches the border and 


j 


define t, Soma 


Witenes recuUrsi Ve Cquae1ons are 
j jaeil 
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(targets) 





0 R (investigator) R 


Pusinews, =n Imvestlcation problem 


al 





f,(X,) max r,(X, dy) 


a 


iL 
and 
ioe P= max melee yt ft. 
ae a ae laa j-1 
J 
where 
x SG, Hel 
Nee x) J 
and 
mom uemrec. <. 6.1. 
ee el 
and 


Ox 


ul 


Meee rtirst constraint on q, limes the  maxamum cistance 


wreehn the investigator can move during time ts ana bine 


second requires that the investigator remain in the interval 


RoR |. 


Nee tnmac Ehe return tunction is 


Kee Oey Jo 
rs (X45) 


J 
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CeMisidemurne Situavronm where k tarcets arrive at 
the border simultaneously. At most one target can be inves- 


meeewed, hence r = IL ait < a0 * = x. for any such target. 


J 
Peeomemcnat if this occurs that the problem is reduced 
femam m-K+tl stage problem since all k targets are 


assigned the same index. 


2a Ceo tmuCremeOlULLOn TOretne Frobléem With One 
imvestumeavor on the Border 


The recursive equations can be solved in the usual 
Wey TO obtain an optimal solution, however, for this 
problem, a simple graphical method is also possible. 

In the graphical method, decisions are simplified 
Pouemmoving that at stage j, given any state = the deter- 
hears on Of whether target j can be investigated can be 
resolved by drawing a cone with vertex at the position 
@f target j and noting whether he is contained inside the 
@eme,  oeec Figure 3.2. The shape of the cone is determined 
by ts and s,. Even if target j can be investigated given 
state See it may oe be optimal to do so since moving to 
Sg may muueuae anVvVeSylealor in a bad position with respecte 
Pmpeeroee to l,e,.+;.,J-l1. This condition is reflected in 
Py _1 6X5 _)) which is recorded for each possible point Xe oy 
on the transposed border passing through target j. 

The graphical solution is carried out by recursively 
drawing the border through each target's initial position 
and recording for each stage 2,...,n the quantity P(X; ) 


which specifies the maximum number of investigations 


possible. 


ay 








stage j 


(not possible) (investigation possible) (not possible) 


iaee 5.2 Cone [or a sangle target. 


The method is illustrated with an example. For 
few problem pictured in Figure 3.1, let Ss, = e and S5 = lis 
fi@enwsolucion is shown in Figure 3.3. The numbers on the 
horizontal lines vive the values of £.(X,). The optimal 
solution shows that the investigator can at best investigate 
Si X meets. 

Pec ole Investigavors on the Border 

The dynamic programming solution method presented 
fer the problem with a single investigator is computationally 
Peaolee sine formulation piven 1S also applicable to the 


problem of scheduling m investigator: against n targets to 


ieee Ze woe mumber of targets investigated. in this 
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stage 





X 


Figure 3.3. Graphical solution to example problem. (An 
optimal sequence is indicated by the dotted line.) 


oH 








meer ron, the problem considered is one in which the inves- 
meeaeors all stay on the border and are permitted to cross 
one another. Their maximum speeds may differ. To handle 
tits generalization, it is only necessary to interpret the 
state variable as an m-vector whose components give the 
positions of each investigator at the time a target reaches 
Miemmerdaer. This 18 easily visualized, and easily computed 
for the case m= 2. The state space simply becomes a 
Hememer Of the plane. Regions in the space are recursively 
mememead CO indicate the maximum number of remaining targets 
Paeeermecal be investigated from that point in the space. 
The method is illustrated with an example. 
4. Example and Solution 

In this section a problem having m = 2 and n = 5 

memeeus 1S presented and solved. Table 3.1 gives the target 


data. Investigator one has speed of one unit per unit time 





fable s2iee larrey data 


for sample problem with m = 2. 
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and investigator 2 has a speed of 2. Figures 3.4 through 


3.9 show the original problem and the functions f.(x5), 


jm 1 ,...,59 where X,,,1=1l,¢ iomue DOs tty lon Ol IAVeSvIpavor 


i at stage j. 


t 
j 
Time of | 
emessing ) ) 
| | 
| 
| 
| 
E | 
| 
; 
3 
2 
7" 
0 3 5 8 10 
Figure 3.4. Problem data for example with m = 2 
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11 
Figure 3.5. £,(X,) for example problem 
Koo 
10 
1 it 0 
ot tf 
| Cones 
: j =a 
X 
5 10 12 


Figure 3.6. f,(X,) for example problem 
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9 413 


Figure 3.7. £3(X) for example problem 


Koy 
10 
5 S 
8 
2 2 
2 Se Ee 
0 9 10 14 


Figure 3.8. £1, (Xy) for example problem 


By. 





10) 


°10|———————u ii ____.__ 


3 y 5 
hj 
5 3 5 
HG 3 5 
x 
0 3 6 10 15 


Figure 3.9. f. (Xe) for example problem 


Note from function £5 (Xs) that the two investigators 
faear DEeSt investigate four targets and this can occur 
Only if investigator one has a starting position between 
Peeec and Six and investigator CWOm@laS eco ai calice DOS alt uOn 
memeene right of four. In the worst case, corresponding to 
m@mesrefpions labeled with a two, the investigators will be 
mere GO investigate only two targets. 

Dooce erary Orcerines 

iWmeordetaslo COnSider arbigrary Orderinegs on the 
solution set, it is necessary to relax the requirement that 
the investigator(s) remain on the border. To solve such 


ereblems using dynamic programming, the state variable x 


36 





must have mt+tl components where m is the dimension of the 
Pepion. Ihe first m components give the position of the 
Mi@vesuigator and the other gives the time. 

Stage j is again identified by the j+i°° target 
reaching the border. The decision is which target to 
ifieeselfatre next. The solution be dynamic programming would 
equate Imposing an m-dimensional grid over the region R 
and performing the standard dynamic programming calcula- 
moma. FOr problems with more than one investigator, the 
dimension of X increases by m for each additional investi- 
gator. Consequently, dynamic programming becomes impractical 
veieverapidly. 

6. Further Generalizations 

When regarding the state variable X as a vector, 
Other slightly different interpretations of the problem are 
mecomole. Returning to the single investigator problen, 
it is possible to permit the border to be m dimensional as 
would be the case when the investigator is guarding a por- 
meeimeot a plane. See Figure 3.10. In this case, the compon- 
ents of X are simply the position of the investigator on 
Gone plane. 

Likewise, some components of X can be interpreted 
to be descriptions of the physical condition of the inves- 
Mmecouor., Kor example, it is possible to permit the inves- 
musacton of a target to change the maximum speed at which 
mpaewinvestigator can travel. This could be used for the 


case in which investigation of some target is a cangerous 


Bi) 





eeeraclon and results in damage to the investigator. [In 
Bree, LNe Occurrence or non-occurrence of damage could be 


permitted to be a random event. 





ferme 3.10 A two dimensional boundary defense pvoblem. 


morechne preblem in which the investigator must remain 
femme border the solution procedure can easily be modified 
Memrmclude several other generalizations in addition to 
i@eerpreting the state variable as a vector. For example, 
each target can move with a different speed and heading. 
The speed will affect the width of the cone and the heading 
Paiematreer its projection on the boundary. In fact, it 
doesn't matter where the target begins or what path it follows 


Wemceach the boundary. It can move in any manner at all as 


38 





tong as its point and time of crossing are known. For such 
@aoes where targets are approaching the border at different 
speeds, it is necessary to order the stages (number the 
targets) so that they arrive in the order n, n-1,...,l. 

DPisOmmnove Lnact a Velie or priority ue can be assigned 
Memeacn target to reflect the importance of investigating 
it. This would be done by letting rs (X, 5d.) = Vi if inter- 
Peer on 1S made and zero otherwise. The problem would 
memain one of maximizing the a 8 summed over those targets 
which were intercepted. 

In another generalization it is possible to assume 
investigation is complete when the investigator is within a 
eeeomence Gd of the target when he reaches the border. It is 
elso possible to solve the problem for the case in which 
Paemeuargeey remains on the border for a finite time before 
femeieatving. lhe case in which a finite processing time is 
feemmemed for each target is also handled easily. Likewise 
it is easy to deal’ with cases where the investigators are 
mvemeailifferent maximum speeds, perhaps zero, in moving left 


Orme ent. 


Gee A MATRIX ALGORITHM FOR PROBLEMS WITH A SPECIFIED ORDERING 
meer cervein conditions it 1s possible to develop even 
Were ,efficient algorithms for obtaining optimal Solutions. 
Such a problem is one in which targets must be investigated 
mga specified order, the investigator is allowed off the 


Porger, and target motion is directly toward the border av 


oe 





the same speed, (see Ref. 41). In this case, investigation 
matecmmere sequence dependent but independent of start time, 


ie. , T,(ts) = I, Op 3k a1 as eg ie as (re 9 


nh eg 
i one Algorithm 


Let t = (11) 2M; ere 7) specify an ordering to 
foeeeme all optimal solutions must conform. If wm is feasible, 


me. , if 


IIA 


oe HO Wome ae) eas ce eyseta hls 


Moemeesegquence 15 optimal. If not, one or more target indices 
Must be excluded from tm to produce a subpermutation which 
is feasible. Suppose TB 1S Une Lairsy Index in Ff Such that 


t een then from among indices n that index is 


T eee ey 


exciuded from n which minimizes the time required to inves- 
tigate the remaining targets. This rule is repeated each 
time an exclusion is required. 
The steps.in the algorithm are as follows. 
1) Index targets according to the order specified 
Mier otie cork tae Wwoper  trianetesot UCne ma by 
(n-1) matrix (I5,) of elements T5 her si < jie 


2) Augment the matrix (I. ) with an additional row 


J 
which contains the escape times for the targets. 
3) Compute the completion time ts i 2 eee 


where 





For the first k such that t, > e€,, 60 to step 4. 


lia Us x e€;; 


of targets to escape 1s zero. 


i = 2,...,n, then the minimum number 


4) For each column 2,...,k compute the savings S. 
where 
Se Sng = Cea oe eee 


5) From the matrix, delete row and column h such 
f 


that 


Se max: {S,, ste ee reese 
Go to step 3 and recompute t,,4's starting with 
target htl. (Note that after the matrix is 
reduced, the subscripts refer to relative pos - 
tions of columns in the matrix rather than ta set 
numbers in the computational formulas for ts 
and S,+) 

The set of columns in the final matrix specifies 
the largest set of targets which can be investigated before 
fmeir escape. 
Eee camp le 
inemaleorivhin wait be dllustrated with the following 
example. Let the augmented matrix of step 2 be that shown 


igeerenure 4.11. 


Hy 





2 3 . z, 6 7 8 9 


2 || eal 13 35 14 29 a5 24 32 
2 | 21(20) 12 15 26 11 16 18 20 
wi 39 33(23) 26 15 16 Ae 14 20 
r ho 59(57) 46 11 11 30 24 
5 48 105 30 35 12 oy 
6 50 5 21 ie 
(i 70 29 its 
8 80 aim 
9 81 

10 | 39 Lo 4g 50 70 +80 81 100 


Figure 3.11 The Augmented Matrix. 


The elements from row 10 have been moved up under 
the main diagonal for convenience. Step Benes been Caguucd 
eueeunti 1 an > ey. t,'s are shown in the main diagonal 
spaces. Step 4 has been completed with S.'s shown an the 
parenthesis in the main diagonal spaces. The quantity Sy 
is a {S,; i Ee ec Ni yoy neil) eliatel exe) I viene! Ht are to ve 
deleted prior to returning to step Bie 

The reduced matrix is shown in Figure 3.12 and 

again steps 3 and 4 have been completed showing 
max {S, ie ors ooy) | Pon le Ss. Row and column 5 are 
deleted and step 3 is returned to again. The resulting 


reduced matrix is shown in Figure 3.13. 
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Z 
5 
5 
6 
if 
8 
9 
10 
micimem sale | the Birst saedwecd Matrix 
au Ale as) S98) 
2 Paa0 js 12 16 
3 | 39° 33(17) 22 
6 40 2 
7 54(13) 
8 80 
9 
10 





Figure 3.13 The Second Reduced Matrix 


Steps 3 and 4 show now that Se 1s Maximum, so 


proceeding as before, row and column 8 are deleted. 
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10 


Figure 3.14 The Solution Matrix 


Tt can be seen in Figure 3.14, after deleting row 

and column 8 and eee Gurmsveome, bnat alll remaining 
t, £ e& and the optimal permutation is Cs 2 Sent So) 
solution also has the property that for Siero lu Gems 72 
which only three targets are not investigaved, this permu-— 
tation completes investigation of those iniesercaved In 
minimum time. 

Fee Proof of optimality 

The algorithm is now proved to produce an Op esamal 
solution. The proof is similar to those used in reierences 
ibemend 32 for the nearly equivalent jobshop poo Lem i 
which processing and set-up times are sequence independent. 
Targets are separated into two disjoint sets, E and L, 
corresponding to those targets which are investigated early 


and those which are not according to the current subpermutation 


being considered. Define 


yh 





DP e=evnOCacemeareets Ou, Oo. the first k which 
have been retained in the investigation 
SiC ie cutmre 

wePomcli@ocemeclrCoecmouueotebne first k which 
nave been excluded from the investigation 


schedule. 


the number of targets in set E lesalensl ile ells, 


le 
for [Ly|)- 


Given that out of the first k targets in the se- 
quence |L,,| must be excluded, then it is optimal to place 


Prose targets in L, which allow the JE, | targets in E, to 


k k 


be completed in minimum time since this will allow the 
Pememnange n-k targets the greatest opportunity to be 
investigated ponore levee Se eco wines s 

The optimality of this procedure can be seen by 
supposing that for some current sequence with /L,| = j, 


< i < 
fee 11, the next target in the sequence has heal er tL] 


= 4 j 
In this case |L,,,| = j and out $8 minimal. On the other 


meme, if t then |L = j+l. The target to be 


pes] es +1 | 


placed in L,,, is target r where r is in E,U {k+1} and 
= = a {S, 
tra So < thet y7 S. > fo aual ae, {k+1} Hence the 


T, in EU {k+l}}. Then 


adjusted time to complete investigation of target k, given 


Bhac One more target has been placed in Lys strsi po qelall glabwnel (ero! 


mymoceleceang r for placement in L Optimality is thus 


K" 


Pievied . 


“5 





ioe Discussion 
It is instructive to MOEN tliat sets algorithm reduces 
to Moore's well known algorithm (Ref. 32], if investigation 


a 


times are sequence independent. If 14; = 153 = 1s 


eng ailal pes Ce, eet investigation times for Pevletpaie eds aie 
independent of sequence, then the elements of the ioe column 
of the problem matrix are all equal. The lor mean pre — 
sented will in this case choose that target out of ohne 1lRsu 
k with the largest investigation time and place it in L. 
This rule is exactly the one used by Moore while obtaining 
optimal solutions to the equivalent job-shop problem with 
sequence independent set-up SLMS 6 

This Section treats only problems whose SO luuenor 
space consists of subpermutations of a single permutation. 
This characteristic allows efficient solution methods ze. 
be developed. nen EAE sole optimal solution may be a 
subpermutation of several permutations, obtaining solutions 


becomes much more difficult. Such Dreobletn sale thecubie ce 


of the following Section. 
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IV. EVALUATION OF HEURISTIC SOLUTION METHODS 


A. INTRODUCTION 

This Section deals with the general combinatorial 
Optimization problem presented in Section II in which there 
are no external limitations on sequence. The solution space 
femmes problem is a discrete set of all subpermutations of 
the (n-1)! permutations of the integers 2,3,...,n. When 
more than one permutation may contain the optimal subpermu- 
Wmimlom, 16 15 necessary to explicitly or implicitly evaluate 
eeeeesuch permutations in any search for the optimum. The 
@epree Of difficulty Bee ostieed with a problem is directly 
metaved to the number of permutations which may contain the 
optimum. 

Meperivence in solving the general problem shows that the 
expected number of computations required tends to rise ex 5- 
femebally with n, the number of targets. Optimal solutio s 
for even small problems, (10 targets), cannot be expecte«u to 
Meameouwained without the assistance of a computer. The actual 
environment in which the problem exists may make obtaining 
optimal solutions impossible in most cases and impractical 
in the rest because computers usually are not available. 
Even when they are, the time allotted for decision-making may 
Meowesuneervainty im solution time unacceptable. In such 
cases the decision-maker has no alternative but to devise 


Sag Use MeuUristic solution methods. 
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If it is necessary to use 4 heuristic, it is clearly 
desirable to use one which is known to be good in some sense. 
Determination of this fact requires the existence OL a 
measure of effectiveness or efficiency for such rules. ibe 
3s felt that the only true measure of an heuristic solution 
method is through comparison of solutions obtained with 
optimal solutions. Other relative measures are clearly 
possible, such as comparative testing. These measures 
4llustrate dominance of one rule over another, but reveal 
little or nothing with respect to the optimum. The clear 
advantage in comparing heuristics to the optimum is that the 
decision maker can stop devising and testing new rules when 
one is found which produces solutions sufficiently close 
to the optimum. Comparative testing does not offer this 
enorce. 

In this Section, a format for evaluating heuristics is 
presented through consideration of one problem formulation. 
Three rules are devised and evaluated through comparison 
with optimal solutions obtained for two sets of randomly 
generated sample problems. Next, the branch and bound 
method used to obtain the optimal solutions 4s described. 
Generalizations of the method are presented, describing the 
most complex target and investigator motion which can be 
expected to be treated. A specific algorithm is then pre- 
sented, in flow diagram form, which can be used to solve a 
large class of investigation problems. The solution for 
one sample problem is shown, followed by a discussion of 


computational experience with the algorithm. 
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Bee vALUATION OF THREE HEURISTIC SOLUTION METHODS 
Peep rooplem description is given, followed by development 
and evaluation of three easy-to-use heuristic solution 
methods [Ref. 42]. 
Pee ider the problem where targets are located in a 
planar region and all are moving directly toward a prescribed 
border. The single investigator moves with a speed greater 
Piemechat of any target and is free to change course instan- 
taneously. Naturally, he always moves at maximum speed. 
iemmeivestigate a target only requires that the position of 
Mmiememyesctigator and the target coincide. Investigation 
meteomeorrespond to travel times between pairs of targets 
Wememmare sequence dependent functions of the time 
Miecuifation is initiated. 
For this problem, the three heuristics listed below 
seem worthy of consideration. Each is an easily implemented 
meremuwmi1ech, upon repeated application, selects a feasible 
Peereron which intuition suggests may be good with respect 
ies Une optimum. 
meee — onertest Time Path. This rule always directs 
the investigator to move next to that target which 
Hometescesu iieunme bo bNe Investigator’s current 
oct LonwprovLlaing thau the investigator can reach 
Hive meh Ore lh ireaches the border. 

Zao es ohortest Distance Path. This rule directs the 
MivecimuceOrmEenmovye Mext to tne target closest in 


distance to the investigator's current position 


NS 





providing that the target can be reached before it 
eOoses piles orcae l. 

feels = Closest To Border. Using this rule the 
ive stipavor procedes mext to Che target closest 
to the border providing it can be reached before 


it crosses the border. 


the solutions generated by these rules are compared to 
Piemopvimal solutions by considering forty problems each 
of which has twenty targets whose initial positions were 
eeeeeeed randomly from a uniform distribution. The object 
Meeeeso Lhe border is considered to be the investigator. 
ieemeuner 19 are the ee nema anand SOLUC Tons | vor 
all problems arecontained in Ref. Ho. 

ieee repion considered is 10 units wide and 10 units deep. 
Meiers, set of 20 problems the investigator has a sped 
Seeeminics per unit time, and all targets have a speed of 
Poeunmics per unit time. In the second set of problems the 
were@eys have speeds drawn from a uniform distribution between 
10 and 20 units peruuM Ly ey me. 

Pacowiate recion 1S used because this appears Co present 
teemmost difficult problem for a fixed number of objects. 
Perce. Shallow region will allow the investigator to capture 
Only those few targets relatively near his position, most 
Saeche Others being out of reach even if he goes toward 


them immediately. A narrow, deep region will present little 
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feenreculLy Since the investigator will normally be able to 
Gapwure a large fraction of the Targets with any reasonable 
sequence. 
1. Same Target Speeds 

The results for this set of problems is summarized 
in Tables 4.la and 4.1b, showing for each problem the number 
memtereecs investigated in the optimal solution and with 
oeeamer che three rules. For each problem the ratio, called 
Meemerreccviveness ratio, of the number of targets investi- 
paved using the rule to the number investigated optimally 
is computed and the average of these ratios is shown in 


Table 4.1b. 


RULE RULE 
Problem | OPT STP SDP CIB Problem ; OPI STP SDP CIB 
1 ial ‘Lo 10 8 11 11 10 #410 8 
2 11 9 3 alk 12 9 7 8 9 
3 11 8 7 6 13 1) 10 je 
y a ait 6 14 10 10 #410 9 
5 ie i205 13 12 15 12 2 ae 2 2 
6 ieee 127 910 16 ee wed 13%o a2 
fh ila 9 9 11 Ly 10 8 10 8 
8 One 10 9 18 9 8 9 8 
g 9 y S, 9 1g 9 i 9 , 
10 9 5 9 6 20 10 Sa 1G SG 


Table 4.1la. Summary of Results for Problem Set Cne 
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AVERAGE OF 
EFFECTIVENESS 
RATIOS 





Waele 4.1b. Effectiveness Ratios for Problem Set One 


It can be seen from Table 4.1b that for these twenty 
problems the best of the three rules is SDP. The STP and 
CTB rules appear to be less effective. The deficiency of 
the STP rule is that it has a tendency to move the inves- 
Cigator outward from the border toward incoming targets, 
foregoing nearby targets which might later be impossible 
to capture since they would have to be "run down" from 
behind. The CTB rule suffers from the deficiency that it 
Poameeemene investigator to make more movements parallel to 
Gne boundary than might otherwise be required. Time is 
thus wasted in back and forth motion. 

Each of the rules is nearsighted and looks only 
wetemeeret anead, but in view of the results presented here 
it would appear that if computer equipment is not available 
tencompUute optimal solutions, the SDP rule should be applied. 
Mees Casier to apply than the STP rule since no relative 
fig@@rev calculations need to be made. 

When viewed in job-shop context, the CIB rule 


represents the rule "process next the job nearest its 
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emeeadave,” and the STP rule the “nearest neighbor" rule, 
(or process next that job with the shortest processing time). 
The results contained in Table 4.1b indicate that there is 
Momemestanuial difference between these two rules. The 
Sere rule has no counterpart in the job-shop problem. 

Figure 4.1 provides a pictorial representation of 
Siemon the problems just for illustration. It must be 
remembered that the targets are moving and the actual ground 
Mmuemerener Che investigator is not that shown in the figure. 


y 
10 


11 40 8 Lay 


eu 





1 2 3 5 7 9 
Figure 4.1 Sample Problem With Optimal Solution 
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9. Different Target Speeds 


The results for this set of Piece ueiis, are summarized 


fm@eples 4.2a and 4.2b. 











RULE 
Colo le ae ODE el 


RULE 
Sue 3s18) 2a eae, 






Problem Problem 


i ee et 
2 ie eal? 
3 5 8 i 
4 (ae 
2 9 9 10 
6 8 9 10 
fi ¢ alle 
8 9 ill 6 
g 9 10 il 
10 5 a 


Table 4.2a Summary of Results for Problem Set Two 


AVERAGE OF 
EFFECTIVENESS 
RATIOS 





Table 4.2b Effectiveness Ratios for Problem Set Two 
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The results from these 20 problems with different 
target speeds tend to substantiate the results given for 
the previous set in that the SDP rule is more aeftecenve Ulan 
either the STP or CTB rules in approximating the optimum. 

Using the data of Ref. ho, other heuristic solution 
methods can be suggested and evaluated. A multitude oi 
heuristics have been developed in the closely related job- 
shop scheduling area, for example, see Refs. 6 , 19; and 


20. 


Cc. SYNOPSIS OF ALGORITHMS USED FOR OBTAINING OPTIMAL SOLUTIONS 
1. Preliminary Remarks 

Optimal solutions being required in the evaluation 
of heuristic methods, it was necessary to develop a means 
of obtaining these solutions. The methodology of branch and 
bound [Ref. 26], was used for this purpose. Possible advan- 
tages of the branch and bound method for such problems is 
discussed in Ref. 16, and examples of applications to similar 
job-shop Dretuiine problems are contained in Refs. 5 , 
ae. 28, emg 34. 

Investigation problems may differ from each other in 
many ways, but from a computational point of view, the most 
pertinent difference 3s in the description of target and 
investigator motion. As OeieS Oi iste sntent of this research 
is to present analysis of a wide variety of investigation 
problems, it was necessary to develop algorithms for obueinine 


optimal solutions for several broad problem types. Each ‘one 
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the algorithms possesses the same fundamental structure - 

an implicit enumeration of all feasible solutions as divecued 
by the branch and yound technique, differences arising 

mainly from the type of motion involved. 

The presentation in the next Section is a descrip- 
tion of the branch and bound method as applied to investi- 
gation problems. This is followed by the statement of an 
pbtera thmic framework which can be used to develop specific 
algorithms through selection of branching and pounding rules. 
The ability to specify usable branching and bounding Tues 
3s shown to be dependent upon the type of motion sh ial \@S IL Keron 
Finally, the most complex, motion for which optimal solutions 
ean be expected to be obtained is discussed. 


gee fhoplication of Branch and Bound to Investigation 
Problems : 


The branch and bound method consists of selectively 
partitioning the set of all feasible solutions and computi 3 
bounds on the objective function for each element at AGS, 
partition. AMelales} process is continued until one element of 
1h OKs, partition containing a single solution is obtained for 
which the associated bound is at least as good as that of 
any other element. 

A feasible solution to an investigation problem IS 
a permutation describing a path for the investigator to 
follow in which all targets contained in the path are iaves= 
tigated prior to escape, and investigation does not commence 


prior to target availability. For such problems, a branching 
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tree is initiated and extended such that each node at the 
end of a branch of the tree corresponds to a feacio les cOLu— 
tion. The set of all such nodes specifies a pee om, Ou 
the feasible solution space. The bounds associated with 
each element of the Benge vO aa therefore with each node 
at the end of a branch of the tree, represent a lower bound 
on the number of targets which will escape if any Soluce 
contained in that element of the jose Galtess0)0 ewes: followed. 
Associated with every MeCCmomernce uree. Sia Gareeu. 
The initial node, representing all solutions, corresponds 
to target number one, the investigator. Branching corresponds 
to selecting a node to branch from and specifying a parece w 
for use in extending the path specie by that branch. ihe 
branch corresponding to node one naturally is selected 
snitially for extension. This branch is extended to the 
right and the left by adding two new nodes to the tree. 


See Figure 4.2. The node labeled k represents all solutions 


Figure 4.2. Initial Branching 
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in which the investigator starts from his initial position 
and investigates target k next. The node labeled -k repre- 
sents all solutions in which the investigator does not 
investigate target k next. 

Associated with each node at the end of a branch of 
the tree is a path, starting with one, and including each 
target number corresponding to a DOs mem Vvely labeled node 
tn the order in which they appear TC omenea. (Or €xXalll= 
ple, the node labeled k in Figure 4.2 corresponds to path 
(1,k), and the node labeled J bo eae Oye 

When a branch of the tree is selected for extension, 
mpempach specified by that branch is called the current path. 

The bound on each ending node with a positive label 
applies to all feasible solutions starting with the path 
specified by that node. The bound on those with negative 
labels corresponds to all solutions starting with the path 
specified which do not include as their next element, all 
negative labels of nodes at the ena of that branch. In 
illustration of this, consider Figure “3, The bound on 
Hegde lapeled 7 applies to all solutions starting with 
elements 1, 2, and 7, in that order. The bound on node 
labeled -2 applies to all solutions starting with element 
1 ana not having either 4 or 2 as the second element. 

After a branch is selected for extension, it is 
necessary to determine When vargers are eligible for use 


in extending the current path. This is done by determining 
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Figure 4.3 Sample Tree 


all targets not in the current path and not prohibited du 
pommecatpively labeled nodes at the end of the branch, wh ch 
eourvd de snvestigated prior to escape if investigated ne 
iiae .orader of an element of the partition reduces £0 
one when there are no targets eligible for use in extending 
the branch corresponding to that element. In Se asc. 
pimleuGargevs are ex, one. in ene current path Bcc Led oy 
that branch, or are known to escape as a result of following 
that path. When an element is located with an exact bound 
less than or equal to the bound on all others, the path 
corresponding to the sole solution contained in that 


element is optimal. 
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Eee) Lhe Framework for Algorithms for Solving 
Investigation Problems 


Specific methods of branching and bounding are 


meno red temporarily while the general structure of all 


algorithms developed to date is presented. This is followed 


by a discussion eit oulures associated with the selection 


of these rules. 


Algorithm: 


1s 


Create initial node corresponding to target number one, 
the investigator. CompeuLre “a bound for this node. GO 
woe 2 . 

Select a branch to extend. This branch determines the 
current path. Go to Sr 

Determine the set & ot wares Siferole pom Use wel 
extending the current path. Put into set E indices of 
all targets not in the current path which Could we 
investigated prior to escape if investigated next. 
Remove from E. all sndices corresponding to negatively 
labeled nodes at the Aral ei tess Whgenetera [keaeies extended. 
if jE] <1, stop. If not, €0 ey He 

Select from E a target k for use in extending the cveerent 
path. Fxtend the branch to the left and right creating 
two new nodes labeled k and -k. Goeto >. 

Compute bounds for branches ending Vase Modes labeled 


k and -k. Go to 2% 
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Upon termination, if le] = 0, the current path is 
oamal. if fel = ah, the current path extended by the 
merece L corresponding to the element remaining in E is 
optimal. 


Meee Difficulties Associated with Selection of 
anching and Bounding Rules 


ic g 

Branching is a two part operation, consisting of 
first selecting 2 branch to extend, and next selecting a 
target for use sn extending that branch. It is a common 
Beactice in branch and bound to use as the first of these 
steps the selection of that branch whose associated bound 
4s smallest and specifying tie breaking rules in the event 
they occur. This rule has been used exclusively. 

The second part of the branching operation is 
Percicularly worthy of note. In this step, 4 target is 
selected for extending the current path. Tt is clearly 
desirable to select a target which will extend the current 
path in a manner which is optimal, or 4s near optimal as 
possible, with respect to the objective. Seme a) eke 
re aces the efficiency of the algorithm by decreasing the 
number of branches required. joa ee webs Uiclse able to extend 
fee iven path through addition Ofom oun ec target in a manner 
which is optimal or near optimal, then repeated application 
Se only this rule should produce a feasible solution which 
jtself is optimal or near optimal. Good rules for use pel 
this step of the algorithm thus correspond to good heuristics 


as discussed in Sections IV,A and IV,B. This fact makes it 


61 





apparent that the output of the algorithm can be used to 
improve its efficiency. for example, an arbitrary rule can 
be used initially in this Seer. optimal solutions developed, 
and heuristics evaluated. The pest of these heuristics can 
then be used as the rule at this Sues snereasing the effi- 
ciency of the algorithm. Additional heuristics can elgkenay \o.= 
more efficiently evalua ved: This learning feavure. Was used 
iO significantly improve the efficiency of the algorithm 
presented $n Section IV,=. 

The bound associated with each branch specifies a 
lower bound on the number of targets which will escape seth 
the path specified by that branch is followed. For the case 
when the last node in the pranch has a positive Lave awe 
loose but easily obtained bound corresponds to determining, 
as of the time investigation of the current joysnelen 20s) complete, 
how many targets have escaped uninvestigated. This bound 
is tightened, with increased computation, by sncluding in 
the bound all Powmee os which will escape uninvestigated ev' 2 
sf investigated next. This hice ey UNS! abe the algorithm 
presented 4n Section ye fie 

For the case when the label of the last node in the 
branch is negative, the lower bound corresponds to the number 
of targets to escape sf the current path is Followed and 
pain Fargevus corresponding to nodes at the end of the branch 
with negative labels are not. investigated next. This bound 
iS particularly difficult to compute in that it must take 


into account all feasible solutions for which the peginning 
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pereron of the permutation corresponds to the current path, 
excluding those having as their next element an index 
corresponding to one of the negative labels just deseribed. 
A method of computing the bound which is Mou proulen oriented 
4s to compute the bound as described in the preceding para- 
graph associated with the current path as extended by each 
eligible target and select the minimum of these as a bound 
on the negatively labeled node. An obvious acceleration 

is provided by computing these pounds sequentially, keeping 
track of the minimum bound computed to date, and terminating 
computation of the bound for a target when it SLi ospbavels wie 
equal the eurrent minimum. This procedure was used in 


experimental testing. 


D. PROBLEMS WHICH CAN BE SOLVED USING THE ALGORITHM 
i Discussion 

The algorithm stated in the preceding section is 
really the skeleton Oe cis Pe Oman This basic structure 
must be augmented with branching rules ana methods for 
computing bounds consistent with the problem formulation. 
The selection of branching rules is not difficult and can 
even be done experimentally. However, the determination of 
usable methods for computing bounds is usually difficult. 

The technique is essentially a “one step, look 
ahead" scheme in which a target is used to extend some 
branch, and the results of this extension are analyzed and 


used as a bound on the path represented by the branch. The 
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jook ahead portion, which corresponds to computing the bound , 
ss carried out by computing the time at which investigation 
pemeiecvargets in the newly extended path is complete and 
determining the number of targets lost as a result ef hee 
extension. 

The determination of whether an algorithm can be 
developed for a particular problem formulation depends on 
whether meaningful bounds can be computed. The Sm ee Lency 
of any such algorithm depends heavily upon the ease with 
which these bounds are computed. 


ee Determination Bap Stuns soe ahie Oi ke Formulation 
en Application ‘oe Ge Algorithm 


I, (t, ), the time required to snvestigate target j 
eanen Bh Woesvicairon of farsecel, is complete at Came Us 
may be called for many times during the computation Ol one 
pound. There may be no known technique for carrying out 
this computation due either to the complexity or uncertainty 
of the motion involved SPOR wed Uae other hand, it may be 
the case that the motion renders the functional form trivial. 
In any case, this is the point where the suitability of the 
formulation is determined. Even though there may be no 
standard technique for computing I, (t, Nerwingee ne: oS computa- 
tionally acceptable, 2 may OC aoe to develop new 
jmeecnniques tnrough unaerstanding and exploitation ef Unc 
marc cular type of motion involved. 

Development of an acceptable functional form wong 


I, (ty) 35 strictly problem oriented and will thus be 
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i1iustrated by example. In the first example, the Mousorn 
Gescribed is such that ,(t,) takes on a very Simple form. 
ingetie second, a Aiea iu ee aniony So ele necessary to determine 
whether the formulation is Suieaole. olver which special 
characteristics of the motion involved are Heulced and ex- 
matorycd in the development of a surprisingly simple func- 
tional form. In both examples it is assumed that an inves- 
iaieecson iS complete when fhe position of the targev is 
reached, all targets are available at problem amers2er OG. 
the investigator changes course Snstantaneously, and that 
the investigator's speed is upper bounded by §,- 

a. Same course and speed. Consider the case where 
all targets have the same course and speed and are proceding 
toward the border. Obviously it is best for the investiga- 
tor to always puocceur al maximum speed in this case. Inves- 
tigation times are thus sequence dependent travel times, 
independent of start time, illustrating that T(t) is sir oly 
the constant Vy Eoue ee = tl. wees eet apt 2 es which can = 
“precomputed eng alienate ete application of the algorithm. 

b. Varying courses and speeds. Consider the case 
where for each i, each coordinate of target i's Desme Lom 1s 

represented parametrically as a function of time. For 
simplicity, assume the region to be planar and let se 
position of target i be represented by the couple 
(x, (t) sy¥4(t))- Let s, be greater than or equal to the 


maximum speed of all targets. 
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It is not clear that a functional form for I. (ty) 
can be specified uniess an optimal policy ior investigator 
speed can be determined. The following theorem specifies 


the required policy. 


Theorem 4.1: Let the speed of the investigator, 35 
be restricted to the interval (0,8,)> Sete, Cam s,(t) < 8): 
Let targets have speeds s,(t), ip = es) 

1 FS ee s,(t), i Cees | 0) Seana 
there exists an optimal solution in which the investigator 


always uses speed S54: 


Proof: Let ™* be an optimal solution containing Nn targets 
in which, on some portion of the path described by nm*, say 
between targets T, and T.44> speed s, (t) < s, was sed. 2e 
will constructively be shown that nm* remains optimal ata 
speed Sy Ls Uistetel throughout. 

Since 1* is optimal, uae < oa for all We abi 
n%. Note that be OR Giga A (tae pues atari J are unaffected by 4 
speed increase Bounce PAcee ron ta, and ™544> but ee Pon 
) = me. s+ 9M may be. Let oe be the completion times after 
the speed increase RO ao = tee eee Consider Figure ie 
Positions A and = 2 represent ae patie © y Jocations of targets 
m, and T.44 see wail ee and path (B,D) represents the motion 


at 
i 
% % 
of target ™;44 during the period tn to trad TON), 
represents the assumed path followed by tne investigator 
using speed s,(t) < S,: Tf speed 8S, were used, some other 


path such as Ch C)) us possible allowing intercept at “@aenic 
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Coe Cees pate eee) 
itl Ts 44 itl Tea] 


Figure 4.4 


te coe Since s, is preater than or equal to the 
at "441 
speed of target T, Bete the investigator could proceed along 


pecmenc,D), arriving at D at some time t prior to Sn eaa” 
and is free to proceed vo # A ee eatin) eehalselers et ion 
position D to tee Ts40° The result is that 
= Pore 4) = Sage sa) eos <8 the speed increase, and 
Bice =, < ae for j = itl,..-,n 1% pemains feasible and 
thus optimal. : 

If there were more than one portion of the path 


on which less than maximum speed were used, the same 


67 





reasoning shows that only improvement is the result of 
increasing speed to Ss, on all such portions. 

As a consequence of the theorem, it follows 
that there exists an optimal solution Tene te slaves va 
Gaver eravels throughout at speed Sy: turning only when an 
investigation is made. 4645 Sy < s,(t) for some i, then this 
$s not necessarily true. In such cases s(t), t > 0, becomes 
qa decision variable, and a solution consists Mou only OL 


the permutation T=(T) gee e oT) but also the speed function 


s(t) gor O < t < oa 


Under the conditions of the theorem, it is 
clearly always best for the investigator to proceed from 
porn: of departure to S(O ale ie intercept in a straight line. 
Hence upon departing the location of target ee) Demonte Uys 
(x, (t,).¥4(t,)); the investigator will proceed away from 
that point at maximum speed Sy> and enus wel al be located 
somewhere on the circumference of a circle centered at 
(x, (t,) 7, (65) with radius ts, where t is the time elapse 1 
since departure. Thus the investigator's position can be 


represented as (x,y) where 
2 Ze 2 - 
(x, (t,)-*) + (y, (t,)-y) = (ts,) | (4-1) 


for some t > 0. The Gesired time, T,(t,)> is the minimum 
time at which the positions of the investigator and CaGEeL 
fc oumcide. iar seun sos position as a function of elapsed 


time t is (x (tytt) sv (t5+t)): Substitution of these 
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coordinates into (4-1) in place of (x,y) yields 
Ox. (b. Jax, (¢,46))2 + (y, (6, )-y,(t,4t))* = (ts,)°. (4-2) 
cis alee pa 8 nats ea tg easel oe 


-Equation (4-2) describes the condition which must be met 
if the investigator's position and that of target j are to 
be coincident. The minimum real root of Che? atc vhe 
desired value I, (ty). 

itt Sy were not greater than the speed of all 
targets it would be possible for (4-2) to have no real roots. 
This would indicate that it is not possible for the inves- 
tigator to carry out the specified investigation. 

Problems in which targets have varying courses 


and speeds have been solved and the solution for one with 


4O targets is presented in Section Veen oye 


pee lypes of Motion Gabaligabeles gle Applicability 
of the Algorithm 


The suitability of a formulation for application 
wee algorithm ae dependent upon the Abalaty ve cOnpuce 
I, (t,) efficiently, which in turn depends upon Pheeue wie 
of target and investigator motion. ‘The complexity of func- 
tional (4-2) is not apparent since functions x, (t) and 
y,(t) have not been described. The most general motion 
which can be handled is Spectiaeq, Oy determining what subset 
of all functions can be used to represent x, (t) and y, (t) 


and still expect the algorithm to produce an optimal solu- 


tion in reasonable time. A large subset of functions which 
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can be considered separately is ae emoe & Oneal pol yioc 
mials. If the positions of targets 2,...,n are expressed 
as polynomials p(t) « P of degree two or less, “then (4-2) 
35 at most a quartic, for which efficient closed form root 
extraction techniques exist [Ref. 34]. For those elements 
of P of degree greater than two, numerical methods could 
be applied, but the efficiency of these methods would 
render the algorithm impractical for large problems. 

It is interesting to note that if the speed of the 
snvestigator is given as 4 function of time, Si ee et) 
Gi=2) becomes 

tga 
(x, (t vox, (t,4t))° + (y(t, ey, (bett))* =e) : s(z)dz)*. 
moat 6Ch)lUL A a ee 7s 
* (4-3) 


This generalization has application when considering jcb- 
shop scheduling problems, sn that variations in Were uc 


speeds can be handled. For such problems, (4-3) reduces to 


: t,t 
Pia = te if SZ az (4-4) 


J te 
a 


where Ds 3 igs the processing time for job j PoOllovime JOD m4 
4f the machine is run at normal speed. For example, if 
machine speed remains normal for some wae t and then begins 
to diminish due to normal wear, s(t) would be as shown shel 
Figure 4.5. It may be that the machine is run at normal 
speed during the day shift, at some lesser speed during igie 


night shift. Such a case 4s depicted in Figure Leos. 
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Figure 4.6 Alternating Machine Speed 


FE. AN ALGORITHM FOR TARGETS WITH DIFFERENT COURSES 
AND SPEEDS 


This section presents an aol nea Loa of Sections IV,C 


peal, GD TO a Orig Wal levies 3e problem. 


(ee 


ft 





this Problem DSB eigntie) cae 


An algorithm has been developed for the problem 
meeecived in Section II,A and is exhibited in the following 
geerton. Ihe motion of target i, i = 2,...,n is represented 
by a velocity vector Cv, Ci) ,v Gi). The position of each 


target at problem time t is (x, (t),y, (t)) where 


Ett) 5 + tv, (i) 
y,(t) = yy +: tv, (i) 


where (x? yy) is the position of target i at problem time 
zero. Assuming the investigator to have speed capability 
Pwoever than or equal to that of any target, the appropriate 
functional form for I5(t,) is given by equation (4-2). 

Tne branch selected for extension is the one with 
fen bound. If there is a tie, the branch with a positive 
label is chosen. If both tied nodes have negative labels, 
mimeeose Node created is used. The rule used for selection 
Giva target to extend the chosen path is the SDP rule dis- 
memered in Section I1V,B. Bounding procedures are described 
femocection IV,C. 

The border is that portion of the x-axis described 
myeuhe interval [0,R]. 

iaesalecorithm for this problem was coded in Portran 
ieand run in experimental testing on an IBM 360. The 


following section contains the flow diagram of the algorithn, 
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foumbowed by an example problem along with its sclution. 


A brief summary of computational experience is given. 


a. 


Flow Diagram 


The following notation is used: 


(x, (t),y, (t)) DOcmeMoOn on tarces dat time t.. 
(v, (i) ,vCi)) = velocity vector for target i. 


LN = sequence number of last node created in 
Pie sOranchene tree. 


SL ) = the label, or target number, associated 
Vol elias (a xels: slay 

PRED(i) = the node immediately preceding node i in 
HOS lereeiak@iali over widow 

pe (i) =—tMe DOuUnd on wmode a. 

B(i) =|BB(i) if node iis currently at the end 
of a branch in the tree. 

M Ovherwase. 

iG) = the time at which investigation of all 
targets in the path specitied by node i 

is complete. 

INV = the target number specifying the location 
‘Or the Jnvesticaver at the teurrent 
era tlet. 

MN = the node number of the last positively 
labeled node in the branch being 
extended. (Note that TN(MN) = INV.) 

BFN = the node at the end of the branch béing 
extended. 

ene = the target selected to extend the current 
path. 

ne (a) = ] if target i is eligible for use in 


extending the current path at iteratic.. 
Gmc. 


0 otherwise. (M large.) 


(6: 





EG) 


UE Ga) 


ieetiavercteGtans lometari ble for use in 
CXvCUCmMp EMC uc te rent DaLh. 


0 otherwise. 


Eire xcepetinavetr (i) =(O'for all targets 
a Corresponding to nepatively labeled 

Nodes ay wemewerarwot the Dranch being 
extended. 


The following is a brief description of the compu- 


Cation carried out in each section of the flow diagram 


Swewaeohn the pages that follow: 


to (B) . Create node i and set IE(i) = 0 
for all targets i whose motion will not take 
Piece cress bie so@iqcei. 


(B) to (). Compute the initial bound on node 
imanderetine the itevector. 


© to (). De ierenilios Wi} eugicl (isle AU ome (che wien? 


(D) to ). DETCererareecr sl) foOriuse an 
extending the current path. BYP 1s the elisipnle 
PieteuecUli@eenlty ly Wemegeeat TO pie Aanyvyest eavor. 
Nemes = FNe ese COMcd eClesest.. 


(E) to @). Compute the bound on node labelec 
levbAle 


(F) to G). Compute bound for NEXT. 
to GG. sequentially begin to compute bounds 

for all other eligible targets, keeping track of 
the Minimum whens initaally is the bound for 
NEXT, and terminating computation when the bound 
Hom a taercel is «loupe, to De equal to The: minrnun. 

G) to (K). Create smew mode Paveled —biT. 

(kK) to Qe Seloeccmrne Dranch TO extend Vexu. 


to Q) . Doleumeremt hen crectee I Cibie 
pemeelomay syne CUrrent, 1teravion. 


COME Dron ecioeroOr verminatwon and prepare 
Ue) jomeioe erbae, sie Ibi eedeiar 


74 








read data | 


1s yes 
XB> R= 


no 


Que, 


eS 


TE(4)#0_ 
E(i)=0 


is 


no 
1=nt+l? 


yes 


i> 





Acs es 
£(4)=0? >— 


wo : : 


yes 





yes 
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MN=BFN 


Zo 


TNV=TN (MN) [ vn=PRED (1aN)| 













TBFN=BFN 


NO=-TN (TBFN ) 


TBFN=PRED(TBEN ) 


is 
nO HA@n(TBFN) > 0? 


tal 





D 





eo nf \ % 
XINV=Xtyy * T(BFN) *v CINv) | 


YINVeYs yy + D(BEN)#v, (INV) | 





MIN=99999_| 
NEXT=99999 | 





j=e 
E 
> 
¢ 


yes 






ee + oma a) 


ae + T(BFN)#v_ (Cj) 






DISt=((x4-Xpyy)° + Oy 4-Yayy)2)" | 


no 





DNEXT=MIN | 





©) 
{ 
LN=LN+1 
(TN(LN)=BTT 
le 
PRED(LN)=BEN | 











TN(BEN) > 02-——= 


| B(LN)=BB(BFN) 









E(BTT)=0 


ee 
[T(LN)=T (BEN) + Tapp (E(BEN)) | 





B(LN)=BCLN)4+1 


no is 
kan i? 


yes 
BB(LN)=B(LN)| 


ie, 





[E (NEXT) =0 


is 
yes 


TN(BFN) > 0?>- 
10 
[ cemP=BB(MN) | | TEMP=BB(BFN) | 


| ENEXT=7 (BEN) + Ty p(T BEN) | 












is 
yes 


yes 





is 
TEMP=BB(BEN )? 


Ne 
© 
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ao yes 
TN(BFN) > 0? 


no 


| TEMPI=BB (MN) | TEMPI=BB(BFN)| 












TATI=T(BFN) + 14 (T(BFN))| 


©) 
© 


E(i)=1 


no is 
ij=nt1l? 


yes 
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| TATK=TATI + 1, (TATT)| 
=yO + TATKRY (k | 
aes ee 


TEMP=TEMPI 


© 
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=-BTT 


PRED (LN )=BFN 
BB( LN )=TEMP | 


[ B(LN)=TEMP 
B(BFN )=N+1 


io l=N+1 




















B(i) * MINB? 


| 
yes is 
——_<B(i) < MINBS 


no 
yes is 
TN(BFN) < 02 


no 


is 
TN Cie 02 


: no 


cares 








BFN=i 


=e 


no 


8 3 


yes 





MM=PRED (MM 





1=2 








1S 


x 
y =y? + T( BEN) *¥ (7) 
ioe a y 


= SN ee 1, (T(BFN) J 


me’. ¥ 
gn saree bat vy (4) 
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STOP=STOP + fstor=svor + (4) 


2s 
SLOr lee: 





| LN=LN+1 | 


(i Gia 
PRED(LN)=BFN| 


|TNCLN)=LAST 
BB(LN )=BB(BEN ) 


(T(BFN) ) 


Pcun)=2 (BRN) i Te ao 
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Eee omple Problem and Solution 
Mimcmaleori chm was used co develop optimal solutions 

memepiroolem sets with as many as 50 targets initially in 
M@@ewrefsion. The solution obtained for one sample problem 
mcm 40 targets is presented for illustration. The initial 
positions and velocities for the 40 targets were selected 
mameomly from uniform distributions, target speeds ranging 
maemo Go 20 units per unit time. The data is contained 


ieelable 4.3. 


Only those 25 targets whose motion would take them 
across the border are shown in Figure 4.7, their initial 
Moeaetons being denoted by circles. The optimal path for 
the investigator is shown with a solid line. The motion 
of all targets is shown with saan lines. Heavy dots show 
the locations where investigations take place. The optimal 
Semcon 1S (1,2,6,4,8,21,13,27,16,23,25,34,20,15,35,28,37)- 

A set of seven such problems was solved on an IBM 
360. CPU time ranged from 2.46 to 78.27 seconds, averaging 
34,91 seconds. The number of bounds computed ranged from 


i@ieebo 2190 and averaged 1251. 
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Max Speed = 
emo 15° 
HOO” = [v2 
8.0 - 8.3 
3.1 -16.8 
15.0 -13.0 
12 =2655 
His eae 
-2.e -13.9 
A QAees: ale 
2.3 16.0 
-15.3 - 4.9 
15 =, 6 
St oe 1 2.6 
-10.9 - 6.2 
~ 0.4 10.3 
een = 3.3 
3.6 -11.9 
0 Bald oe 
9.8 - 6.4 
Table 4.3. 
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Example Problem Data 
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Sample Problem and Solution 
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Figure 4.7. 





4, Remarks 

Farlier it was noted that the efficiency Om an 
algorithm is directly related to the efficiency with which 
the waine T(t) could be computed. This can now be 
mahiserated. 

The algorithm presented in this section was used 
to obtain the optimal solutions used in the evaluation of 
heuristics in Section IV,B. The motion in the first twenty 
problems considered there specifies that Se bareeus: so 7c 
toward the border at the same speed, and in the second, 
targets move toward the border at different speeds. For 
the first problem set, 1, (t,) is independent of time of 
imitation of investigation and thus i weauces vO Th? 
fei. 1, J = 25-229 which were computed and stored 
prior to application of the algorithm. In the second 
problem set 1, (t,) isa eame dependent and nad to be computed 
each time it was required by the algorithm using a modified 
form of equation (4-2). A comparison of computational 


results is shown sn Table 4.4. Times are given in seconds. 





AVG CPU OTD. AVG # : SEUe 


Motion Type Mame DEV. Bounds | DEV. 
| 
Same Speed | OS tha bi 331.9 | 22s 


Different Speed ee jh eede | 540.2 709.4 


Table 4.4. Comparison of Computational Results 
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Note that even though the average number of bounds 
sncereased only by a factor of 1.6, the average CPU time 
sncreased by 2 factor of 7.3. Tt is thus clear that the 
percentage of time spent in carrying out the T(t.) compu- 
tation is significant. For the second problem set this 
percentage is conservatively estimated using the data from 


Table 4.4 to be 602%. 
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V. UNCERTAIN INVESTIGATION TIMES 


A. INTRODUCTORY REMARKS 

Miealt problems considered thus far, investigation times 
I,(t,) Were required to pe known with certainty. The actual 
random variation in these times is ignored for the obvious 
reason of simplification. However, even in the simplest 
Pormulations, these variations may be significant enough to 
warrant the added computational burden involved in accounting 
for them. 

The nature of the variation is usually such that it can 
Pamooroximated in distribution. It is a common practice 
in jobshop scheduling to approximate set-up and/or processing 
mejesmusing a normal or related distribution. Similar 
PeProacnes appear appropriate for investigation times. For 
example, if targets are ships, travel times between known 
Memes will actually vary due to changing wind and sea cor i- 
fons. lt is felt that these times could be closely appr <i- 
mated using a distribution in the normal family, parameters 
for which could be developed by fitting with an experimentally 
developed sample distribution. 

In order to determine the feasibiliy of a solution To an 
mivestigation problem, it is necessary to be able to compute 
memesctimate the time investigation is complete for each 
target included. Hence, for solution 7, it is necessary to 


compute cee mom m= 1 sc.s2,m Where 
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Note that assuming investigation times to be known only 
in distribution makes T,(t,) a random function for i=l,... Nn, 
j=2,...,n. If the distribution of random variable T,(t,) is 
known and happens to have the reproductive property Ret. 25d 
then the distribution of vires also known. The normal random 
variables may thus be computationally advantageous in that 
5] is again a normal random variable with known distribution. 

Under this assumption, it is possible to efficiently 
solve certain types of investigation problems using the 
Meemmaagues of probabilistic programming. The class of 
problems which may 1ena themselves to these techniques 
includes problems having an integer lanear programming for- 
mulation in which the number of constraints is not prohibi- 
tive. For example, if it is possible to reduce the SolLuy von 
set to subpermutations of a single permutation, as in 
Section III, then solution techniques for at least moderate 
size problems may be possible. 

There is one group of investigation problems WaLen) as 
known to be solvable using these techniques and an efficient 
algorithm for obtaining optimal solutions has been developed. 
ime problem is described and solved in the sections which 
follow. The problem is best understood using the notation 
and terminology of jobshop scheduling, in that a special 


case of the problem is well known Peer. 32 4. 
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B. SCHEDULING WITH DUE-DATES AND UNCERTAIN SET-UP 
AND PROCESSING TIMES 


mie SiulatLon treated is one in which a single machine, 
(investigator), is used to process a presently available 
set of jobs, (targets), with known due-dates (escape times). 
meem JOD consists of a single operation but set-up and 
processing times (investigation times) are random with 
Known distributions. Once processing of a job has been 
Mmemertaved, it 1S processed to completion. The objective is 
Memope city, prior to commencement of any job, a schedule 
which will minimize the number of late jobs. 

im Sev-up and processing times are known with certainty, 
Moore's algorithm can be applied to produce the optimal 
memecule a5 follows. All n jobs are ordered according to 
non-decreasing due-dates and partial schedules up to job i 
Mmpeeemceduence are considered for i = 1j2,...,n. If job i 
fomeieeoe late if this ordering is followed, then from among 
memos one through i, that job with the largest processing 
time is excluded from the schedule. Repeated application of 
mores ExXCluSion rule each time a partial schedule shows that 
emoo must be excluded will produce a schedule in which the 
momoer Of late jobs is minimized. 

ity the problem being considered set-up and processing 
times are assumed to be random. The problem is cast into 
the form of an integer program and the constraints trans-- 
formed into chance constraints. A certainty equivalent for 


[eore S (Ob ewith the Tongest processing time is achieved and 
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meeemeralization of Moore's Algorithm is presented. The 
meee im 15 then proved to produce an optimal schedule for 
mie Geterministic equivalent problem. 
m integer Programming Formulation 

fie 1S assumed througnout that processing times and 
set-up times are independent normally distributed random 
Variables. The set-up and processing times for each Job are 
summed to form a new random variable p, called simply 
processing time. 

The problem will initaally be formulated as an 
integer program. Let Ds be the processing time for job i, 
meee, ...,n and d; pier Oue dat Cm ueL Xx, = dye hg |e) aw oa bes: 
imemuaed in the schedule and 0 otherwise. Jobs are indexed 
euch that qc, £ On oa qa Associated with each job is 


meeomsvraint of the following form which requires, if the 


Mmeomls processed, that it be completed prior to its due 


date: 
ee 
2 PyX, < 4d, ee ips ait (5-1) 
j=l 
eal 
mae Objective is to maximize : X » the number of early 
jaa 
jobs. 
2. Chance Constrained Formulation 


As the coefficients in (5-1) are random, these 
Podsurainues Gannot be met with certainty. Application of 
the technique of Ref. 9 transforms inequalities (5-1) into 


biokeeOlauraimnus Where tne degree of risk is determined by 
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the decision maker.: The problem then becomes 


J=n 
maximize ry ae 
jal 
j=i 
Subject tO te : Pen Se toe y Laas 
j=1 Al 73 = 1 — 


GAZ) 


Constraints (5-2) now require that whatever schedule 
be selected, it must satisfy (5-1) with probability at least 
equal to a. 

Note that the left Mand =side Of Caen constraince in 
(5-1) is a sum of independent normal random variables. 


howeioing a constraint in (5-2) as 
P| Chea ee hae 0) eo a (5-3) 


meemnormalizing, the €quivalent form 


| ee 


: Vs i y pa (5-4) 


Cte 
nl m1 Il 
Je 
C4 
it tat 


o((d, = ye 


J J 


fmemooOvLained where © is the cumulative distribution function 
for the standard normal random variable and D, has mean m. 
and variance vie Letting K be the inverse of d, CONsSeralny 


(5-4) becomes 


Co 
" 
jo 
Cus. 
> 


1 
ie 


(o> ey a el 
m (a) ( 4%3 


(5-5) 


i es it 


(oo. 
}) 


gD 





Auxiliary spacer variables [Ref. 10] are introduced to obtain 


two constraints from (5-5) as follows: 


yen 
ame re. aes 4 6le 
ee oe Couel 
(5-6) 
2 5 
- OR Fe aa: y,/h Eno) 
j=l 


where h = RE). . is replaced by Xs since being either 
for 1. it has the same effect, and Ys is the spacer variable. 


The final problem is 


Jae 
maximize y. oe 
i 
sige 
subject to Eo omX, sees d, 5 Opes OY ara erier (5-7) 
yen 
ae 2 
- a Vix + y,/n 0, al Eo oe (5-8) 
X 5 a ial Neg > 0 


The resulting problem is a nonlinear integer program 
ming problem with n quadratic constraints. Due to the 
integer nature of the x; the problem remains impracuau le. 
even in this simplified form. It is possible, however, 110) 
deduce a great deal about the nature of the solution through 
inspection of constraints (5-7) and (5-8). 

Note that in (5-7) instead of having a job's comple- 


tion time constrained to be less than its due-date, as it is 
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in (5-1), the expected completion time plus a risk aversion 


meecor, y ime Mineo roubDomleSomtial tne Corresponding 


aa 
due date. Note also that (5-8) requires that tne risk 


aversion factor be such that 


(5-2) 


<< 
lv 
vovVO-nm™/ 
Se 
nom il 
< 
os 
wt 


As can be seen by consideration of (5-9), larger 
megmances Of jobs in the schedule up to and including job i 
produce a greater risk aversion factor Ys. ema theretore 
more slack is required in constraint (5-7) over and above 
the expected processing time. 

3. Development of the Deterministic Equivalent 

The above observations are exploited and extended 
memprocuce a method of arriving at an optimal solution to 
mie cCransiormed problem. 

itemoroolem cdCevelopment Cf isecuions V,8,1 and V,Bi2 
Eeurectively states that in order to arrive at an optimal 
weamecuile, one Should order the jobs according to due-dates, 
compute the adjusted expected completion times of jobs in 
ascending order of job index number, and when the first job 
in the sequence is encountered for which constraint (5-7) 
moeviolated, select from among the jobs included in the 
PeGuenoe Up FO tial DOInt one for exclusion from the sequence. 

ILS rag shales I. Pepeeseiu une anGdex seb for jobs iInciuded 
in the schedule up to job 1, when applying Moore's algorithm, 


Peborolabecemcaule isesdevyeloped until job i is encountered 


Sil 





such that 


y Pee eee. (5-10) 
jel, 
Moore then selects for exclusion that job whose exclusion 


minimizes the left side of (5-10), i.e. job k where 
P, = max Pp. ; aati (5-11) 


fees this minimizing characteristic upon which Moore's 
moot of ootimality ise cic e Cle 

The certainty equivalent for Moore's job with the 
longest processing atic mec Ome sdentified in the following 


Peeiosion rule. 


EXCLUSION RULE: In the deterministic equivalent opare] om erep tie 
when a partial schedule Is 4s developed for which COMMS uit mew 


(5-7) is violated, select for exclusion from I; index k wl :re 


| 5 1s 6 
me the{ CE yay CF yh) 
JES; jel. 
jxxt 
(5-12) 
1 l 1 
= max meme 2 Cr vole 
teu . Jets ' yer 
4 jzrt 


This is now shown to be true. It is useful to 
rewrite (5-7) and (5-8) as a single constraint by substituting 


the right hand side of (5-9) into (5-7) yielding 
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<d 1= Wen 35-13) 


Suppose (ss) is Satictied for job 1-1, but not for 


ioe. Lher the following condition exists: 


=i-1 
jzi-l J 5 

Ve lee eee tet ed ae Ss oe) (5-14) 

jen er jell 
and 

jai state es \ 

B m,x, + (h 2» vix,)* > d, (5-15) 
j=l Ji jo! Jod 


where Xa=d One? ei I, and K=O Othcrvise., = Livy ris in I. 


and x, jemset Go zero. the Hert side ef (5-15) is reduced by 


] 1 
45 fs 


x? Vs 
Aedes eek. 
* j¥ro 


Setting x,=0 produces a left side in (5-15) less 


m +h 
i 


than or equal to d,_, due to (5-14) and d,_, < d,, hence 
setting X,,=0 where k is determined by (5-12) also produces 
a left side in (5-15) less than or equal to d,; leaving 
[I,]-2 joOossseMoauleeaenor complerion prior to their due 
dates, where |I]| is the number of elements in the set I. 
In addition, among all possible schedules which complete 


[ele jobs prior to their due-dates with probability at 


least equal to a, rule (5-12) specifies that schedule which 


we 





does so in minimum time. Repeated application ee, Weleul cy aU S 
each time an exclusion is required ensures an optimal 
schedule. Proof of optimality is presented in Sect rom: ano. 
4. The Algorithm 
The steps of the algorithm are 
1. Order the jobs in due-date order. Set Ty = id, meoecu 2. 


Compute h = Come oe Bor toms cep ec. 


0. If i = ntl, stop. Otherwise form 1, = I, sti. Go 
HOmSULeD 3. 
1 
fee tC m. + (h 2 ve) is d.> eet i = i+] and go to 
jel, jel, 


Be 2. If not, go to step 4. 
4. Select index k using the exclusion rule and remove k 
1 seropaTl I,. Set i=itl and go to step ec. 

Upon termination the indices remaining in set I, 
represent an optimal schedule under constraints (5-7) and 
(5-8). | 

Consider the following variation. Suppose among the 
original set of jobs there were one or more special jobs 
which the decision maker wanted included in the schedule no 
matter what the consequences to the resulting schedule. 

This variation is solved optimally under the acc 1b oma! 
constraints by applying the above algorithm except tite mie 
indices of the special jobs are never included in the set Il, 
ites, never considered for exclusion from the schedule. In 
this variation it may be necessary +o exclude more than one 
job in order to ensure that a special job be included in 


the schedule. 
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5. Example 
Pie Soc CMimiomliWouwratced with the following 


example. The data for the problem are shown in Table 5.1. 








Job 
Mean 


Variance 


On aes UJ 
Ud 
+ 
ete 
t 
ee 


Due Date 


Table 5.1. Example problem data. 


For an arbitrary choice of a = .84, h is computed 
to be approximately 1.0 at step 1. A new iteration is 
initiated each time step two is executed for the next job 
Mieeme sequence. The six iterations required to solve the 
example are discussed below. 

oo devslenc ME eS yal ye m, + v4, = 4 which is less 
than 6, the due-date of job 1, so job 1 satisfies (5-8) and 
mes Set equal to 2. 

Creme ots smyernts (ys 


eaeecus Gue-date di for job 2, so some job must be excluded. 


i 
+ v5) %#~13.16 which 


In step 4, for r=1, m, + vi = 4, and for r=2, m, + v 


lle 


o 
8.16, so k=2 and I, is now set equal to {1}. 


3,4,5. In iterations 3,4, and 5 no jobs require 


exclusion. 


teal 





6. For i=6, tas tees. 5- oh... and 


i 
: + vi + Ws + ve)? 4 31.83 


m, + m. + m), + m- ily (vs + Vv 
which exceeds due date 31 for job 6, so one more job must 
Memexcluded. At step 4, k is found to be 6 and 6 is 
memoved from I¢. Tie eaemaun hase Maiees 11 I¢ FEDreschee ane 
optimal schedule. 

fimciikeiees Were =asaumed GO be Zero, this algorithm - 
corresponds exactly with Moore's and the optimal schedule 
would be {1,2,3,5,6}. However, due to the uncertainty of 
Mmecessing times and the requirement to complete the selected 
schedule with probability at least equal to .84, two jobs 
were required to be excluded instead of one. 

oe rroof of Optimality 

lene sassumeadrtuaal apDpiscation of the algorithm oi 
section V,B,4 to the problem with constraints (5-7) and (5-8) 
mete (5-12) as the exclusion decision rule does not produce 
an optimal schedule and a contradiction is shown using an 
inductive procedure similar to that of Ref. 39 

Let B be a set containing k jobs excluded by the 
Mileor thm. Assume there exists another set C containing 
k-1 jobs which allows n-ktl jobs to be completed prior to 
mieir due-dates, indicating that the solution obtained by 
mie a2leorithm is nov optimal. A contradiction to this 
assumption will be shown. 

Let B, be the set of indices for jobs excluded from 
tala 


the sequence up to and including consideration of the i 


job in the sequence upon appliation of the algorithm. Let 
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Cs be that subset of C containing job numbers which are less 
mira) Or equal to i. Clearly Ch = C. 


The proof will inductively show that 
Ic, | 2 (Ea Rec cles eee (5-16) 
The assumption requires for all i that 


J 


j 


(5-17) 


to tt 
= 
ms 
= 
o- 
OE 

hom tt 
< 
ms 
ad 
lA 
Q, 


where ee i eon ae ies ly C. and x= 1 otherwise. 

Let JEG be the first job encountered which fails the 
Mmemuedn step 3 of the algorithm. The induction begins by 
showing that C. Musv1e@Cnvall One “Or more job index mumbers. 

al 

(Clearly [B, | < Ic. 1, figve shetl 9  Re yal) 

Given index ay > the following condition exists: 

ay Nezent 


‘ 1. 
ym. + (h F yo)? > ad : (5~-1€ 
=] a fea J TT 


J 
Going to step 4, job J, is selected for exclusion 
il 


from the schedule using the exclusion rule with 


i = 11,2,..-,a,} and b 


ay , is placed in Bas? making Ba = oly 


Inequality (5-17) requires that there be at least one 
mitotic. , eee | Such that J is excluded from the schedule, 
1 al Cc 


1 
hence 


ers 





Note that if Kon | = 1, the left side of (5-18) when Jy 

i: a 
is excluded is less than or equal to the same sum when 
J is excluded. 

oy, 
Proceeding to the inductive step, suppose the 
\ 

peeoritvhm has considered i <p <n jobs and that m have 


been excluded. It is thus assumed that 
= B ea te = 
m= |B,| <|c,| = 4 


Two cases need be considered. If m < q and/or no job 
mequares exclusion at iteration ptl, then the induction 
requirement (5-16) is trivially satisfied at iteration 
Mtoe Li m=aq and an exclusion is required at iteration ptl 


it must be shown that mtl = is less than or equal to 


ie Note that application of rule (5-12) each time an 


aul 
exclusion is required and the fact that (5-17) must be 
satisfied guarantees that the left side of (5-13) with i=o 
and ay 1 pies oe seals gi es and x =I otherwise will be less than 
or equal to the same sum with x4=0 ONG a lela Cp and Se 


otherwise. 


SiIMCesexclhUsioOnets reculred at iteration ptl1, 


jeptl j=ptl 


2 L. 
Seem or tone as Vee) > 2d (5-19) 
je) 2 jay Jd pt 
where ee 1icae 4) Bana Bye and x,=1 Otlemwiuse,. But the Pert 
side of (5-19) with oO Ot eae o and x=] otherwise 


exceeds the left side of (5-19), and thus (5-17) will be 
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violated unless at least one more job index number is 


Gonvained in © eta Thus 


aren e [Ba 


Mmeercoicular, let p=n-] and the desired contradiction to 


the assumption is achieved. 


Gee REMARKS 

In this section, one problem formulation was solved 
eomimally through application of the chance constrained 
programming technique of Charnes and Cooper [Ref. 9 ]. 
Sener formulations may suggest application of different 
mecmargques in probabilistic programming. Me 1e Meo.genmlolsorme and 
Meeplems in which some or all of the escape times are 
uncertain and an integer programming formulation appears 
tractible except for the random elements in the constraints, 
immay be possible through application of "Linear Programming 
Under Uncertainty" techniques [Refs. 14 ,15,29] to move all 
random elements into the objective function and minimize an 
expected value. 

mmewapplacabldity Of Ehe Dranch and bound cvechnique To 
problems with random investigation times is unclear, however, 
the possibility is enhanced due to the work of Clark [Ref. 
11] in which a method of approximating moments for the 
maximum of a set of normal random variables is developed, a 
procedure which could be used in the development of branching 


rules. 
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VI. NON-ZERO RELEASE TIMES 


A. INTRODUCTION 

Reepver fil considers problems for which a known ordering 
nS ee enaliy imposed on all solutions and all targets are 
available at time zero. These problems are demonstrated 
to have efficient solution methods. Assuming that targets 
are all available at time zero corresponds to the standard 
Besumption in job-shop scheduling that all jobs are available 
Mereeprocessing at time zero. This assumption is very re- 
Eemieret 1 Ve and seriously conflicts with the actual circum- 
stances surrounding both job-shop and investigation problems. 
mumeo@on areas there can be, and usually is, plentiful infor- 
meron concerning future arrivals. “This Chapter concaders 
mecmumpl ications of using this information during optimization 
more ad OL ignoring it. | 

The analytical treatment of job-shop problems is very 
seriously complicated by the introduction of non-zero re- 
lease einnes. GA ready times or earliest start times), 
and as a result, very few attempts have been made at ad- 
dressing the problem [Ref. 12]. Each such attempt treats 
an objective related to flow time. The zero release time 
assumption is made to allow analytical treatment and is 
tolerated only because of the rate at which things happen 
in the job-shop. Schedules can be developed for those jobs 


currently in the shop and used until the number of new 
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arrivals increases to some point where the current schedule 
is no longer meaningful or acceptable, at which point a 
mereescneauie is developed, taking into account all old 
mamorecessed jobs and all new arrivals. 

MiPriivcayiaau en problems... tne rate at which events 
Seeur can be much faster than in the job-shop and the result 
eeouLpOptimizZging over the set of objects currently in the 
eeenenm Of Interest can render the schedule obtained meaning- 
ier cone 1nvestigavor has anformation concerning the 
ieeatlon and motion of objects which are currently outside 
the region but will at some future time enter and pass 
mmeeouch, then it is desirable to attempt to take these ob- 
feers Into account when selecting a path to follow. For 
example, in the missile defense problem where the investi- 
gator is a missile system and objects are enemy missiles 
emenmarircratt proceeding toward the formation, Var Gua ya. 
Belersions regarding the order in which targets will be 
Gaken under fire should be made prior to the entry of any 
target into the missile envelope of the missile system. 
Wms, if Chis case, it is desirable to have the analytical 
mecaumens Of Ehe problem compllete before any object enters 
the region. Any method which assumes Zero release times 
for all objects is thus worthless in such cases. 

This chapter presents the results of analysis of the 
fundamental structure of the non-zero availability problem. 
Mew netacton sida Ferminolocy used throughout this chapter 


is that of job-shop scheduling as contained in Ref. 12, 
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because the set of assumptions made to allow the analysis 
Sasos che investigation problem into the exact form of 2a 
“particularly easy to understand, (yet very difficult to 
solve), job-shop scheduling problem. 
ite teneory developed as exploited in the construction 
Sresimple aigorithms for obtaining optimal solutions in 
wean cases. For vnose cases where a combinatorial 
Seeroach cannot be avoided, it is shown that the theory can 
be used to drastically reduce the feasible solution space 
for a problem and also provide rapid accelerations for any 
Membinatorial algorithmic approach. 
ier croblem statement 
acm Gwar moO Men ie Heol anne hows mitabOt Keterenee 
iis as Paiste 
J. = job number i 


ae 


[il un 


aasuUvsSerlpe, FO GCemeve Lie element of 


a sequence 


ea = the ae job in a schedule 


Ps = processing time of J 

re = release time of Js 

d; = due-date of Js 

Wy —I Victim iniewlmaLat l the svart Of J. Vasa seme 

schedule 

Cs SS COME TOM cb Ime Of J. in some scnedule 

L = ©. — d. = lateness of J, in some schedule 
a i aE 7. 
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i = max(0,L,) = tardiness of J, in 


some schedule 


(dap laye co ba, = a permutation of numbers 1,2,...,n 


DD order = non-decreasing order of due-dates 


DD schedule one with jobs arranged in DD order 


R order = non-decreasing order of release 
times 
R schedule = one with jobs arranged in R order 


i+ j, spoken "i before j", means that Js is 
scheduled before J. 

Consider the job-shop problem with one machine and 
feepeoes in which, for each i, job i is released to the shop 
for processing at time Des takes Ps ViaGGe Ot Gime slo “pro 
Peon and 1S due at time d.. A jJO0D ence started is pro-— 
cessed until completion. Let set-up be sequence independent 
and included in the processing time for each job. Jobs 
Ween cannot be processed prior to their due-dates are not 
processed, (or are processed at the end of the schedule in 
any order). . The objective is to maximize the number of 
jobs processed prior to their due-dates. 

Letting m be the number of elements in permutation 
m1, the objective function, f(1), for this problem is simply 


m and the problem statement is: determine 2 7 which will 





Mesa Ze mM 


Subiecy to 
JHi 
ae Pa, < oT ee ee eres til 
jzi-l 
= Pi) z "IL, a eons Lae aad 


The set of all possible solutions tT includes all 
permutations (i,,4,,---,1,) Qe iamuyeeers 11.2...) .),n} for 


feels... ,n in which each element i, in {1,2,...,n} appears 


’ 


atc most once. 
ep oeparaba lity 
fv iS pessible for a problem to be separated, or 
Peer ioned, into smaller subproblems, each of which can 
be solved independently. Two conditions under VWiheke hm eh ac 
partitioning is possible are presented in theorems 6.1 anc 
Oya 


Let jobs be indexed in DD order. 


Theorem 6.1: Schedule all jobs in reverse due-date order, 
mamaring release times and observing due-dates, such that 
all jobs are completed as late as possible. Let there be 
fapecenirences Gl maciine agile time in this Sehedule. The 
n job problem can be partitioned into ktl independent sub- 
poMostss oT ay where ny 1 n, en 2 Ne] 


Let Syosee oS ay be optimal solutions to subproblems 


Pe oe nome ou male solution to the mn job problem is 


problems of size n 


Sy So rer S Lay? sets being arranged in DD order. 


LANG 





Proof: Let Figure 6.1 represent the schedule described 


showing the first occurrence of idle time. 


Figure 6.1 


Note that whatever partial schedule is considered from 
among jobs {1,2,...,n-2}, it must be completed prior to 
Bs or it will not be feasible, i.e., Te wild eeomealn jac 
least one job whose completion time exceeds its due-date. 
Note also that whatever partial schedule is considered for 
jebs aiver J-2? 44 will never be necessary to have ie es vane 
pater CO ose Hence, if an iterative procedure 25 used to 
®oeain an optimal schedule which considers jobs in DD Orde: 
the process can be terminated with J-2 and restarted, 
considering only jobs ee and se starting at time 
max [d__o» reqs: 

The same reasoning applies to all cases of idle 
time. The optimal schedule to the n job problem will 


clearly be the union of the optimal schedules to the sub- 


problems with each job scheduled as early as possible. 


ret 





fieeren 6.2: Schedule all jobs in R oraer, observing 
release times and disregarding due-dates, and scheduling 
each job as early as possible. Let there Dee eeocecurrences 
of machine idle time in the schedule. The n job problem 
can be Barer 1oned LNto k+l independent subproblems Oi “cage 
where ny EE No a a = rue ae u 


k+1] 


Syoee S47 be optimal solutions to the subproblems Lohan 


k+1. The optimal solution to the n job problem is 


Ny Moses My] 


S35 S5 se Sy? sets being arranged in R order. 
Proof: Let Figure 6.2 represent a partial scheduie developed 
as described above showing the first occurrence of idle 


time. 





Figure 6.2 


Note that whatever partial schedule is considered from among 
jobs {3,...,n}, it can start no earlier than Pr. Note also 
that no matter what the due-dates are Ore ous J5 and Jos 


4t will never be necessary to have a completion time for 


Sig) ieyelstalle Is: osoolel peal ole constructed through 


Lie 





consideration of only jobs Jy and J5 which exceeds D3: 
Hence, an iterative procedure which builds an optimal 
schedule by considering foe 209) 1s order can terminate 

after consideration of J5 and restart at time Ps aiesu@lon mak) ayes 
pi preceeding ols. 

The same reasoning applies vo all occurrences of 

4dle time. The optimal schedule for the n job problem will 
clearly be the union of the optimal schedules for the 


subproblems with BILL lens scheduled as early as possible. 


Meme 6.2.1: if the DD schedule is identical to the R 
schedule for a problem, then the R partition can be refined 
using the DD partition, or Vice Veroa. 

The validity of the lemma +s obvious since both 
partitions apply to the same sequence when SID: ie ee 
following example is used to demonstrate aa appliLeaperaly 
of the lemma. Let P be the DD partition and Q the R 


partition such that 


rd 
it 


2 ee topo. (st 


EL 62 eRe IR Lr SST 


D) 
i 


Then the refined Darts tome rs 


na ee (55050) )- 


aS 





ia aliecthat Follows, each problem discussed is 
assumed to be reduced to minimum size and jobs renumbered 


using integers 12 Aree o0c 


B, DUE-DATE SEQUENCES 

Under certain circumstances 10? is possible to determine 
that there exists an optimal schedule in DD order. In 
these instances the search for an optimal schedule is greatly 
simplified in Pheer TOM LyonOme of the n! possible ue Test) 81S) 610012 eae 
tations, that beane a permutation containing all n elements 
fee, ..,0)}, need be eonsidered. Letting jobs be indexed 
tn DD order, the problem reduces to determining the minimum 
number Rerienents which must be removed from the permutation 
gee. - jm) in order to produce feasibility in the schedule 
represented by the remaining elements. A very simple algo- 
rithm is presented i Gg e Eero ue) a VI,B,2 which obtains optimal 
schedules in such snstances. Section VI,B,1 presents 
conditions under which there exists an optimal schedule in 
me order developed througna da series of pairwise comparisons 
of job parameters. 

1,  enewaieil e Orderings 

When presented with a set of jobs and their param- 

eters, P;> Ps and dss st is possible to Svave , depending 
upon the results of pairwise comparisons of these parameters; 
that certain trial permutations need never be considered in 
any search for an optimal schedule. In some snstances, all 


but one trial permutation can be eliminated. Theorems sr 
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fee, and 6.5 derive the most general conditions known under 
which this is true for the DD permutation. 

The first theorem eliminates trial permutations 
from consideration through comparison of adjacent pairs 


of jobs in any optimal schedule. 


Theorem 6.3: For every pair of jobs J, and Js44 such that 


Ae 3f there exists an optimal schedule containing 


fs “4+1? 
both Js and Js44 sn which itl < 4, then there also exists 


an optimal schedule in which i+ itl. 


Proof: The form of the proof is to assume that a is an 
optimal schedule with itl * 3 and show that schedule So 
which is identical to s+ except that the two jobs are 
switched such that 4 «itl, is feasible, and thus also 
optimal. Note thav all jobs in st scheduled before J544 
errceaiter J, abi pen uncmeceucd. 2y the switch, (see Figure 


6.3). Since S is feasible, d, 2% 


says. Or) < ae Let 


k 





Figure 6.3 


ILS 





WT. be the start time of J, after the switch and Gs be 
a at fet 

the completion time of Jsay after the switch. The facts 
d. 3 Os44 and rs OSE aes imply that 


DAE OFS and Oe = Wy < S544 
so J and Jsay will both be feasibly schedule in oe 
showing that 4 is also optimal. 

The second theorem eliminates trial permutations 
from consideration through comparison of arbitrary pairs 


or JOOS. 


Theorem 6.4: For pairs of jobs J, and J, i a ee Ser oar 
+ _ : : 
re > Pas and P; iF > d. Ty» there exist no optimal 


schedules containing poth Jy and J AGuiemey -- eee 


Proof: The proof will assume the existence of an Opuimas 
schedule with j 2) aid) Slow «2 contradiction. Assume 
ey Sareea cg or > d. Se, ayeiel 


1 J J 
>. there exists an optimal STE GIb Se ee Ns) ames 


1A 
Q 


In any feasible schedule with Jj « 1; me z r, and Cee 


+ + 
Clearly Cs 2 a D; 4s hence 


Gas d. = Wee PS) 


A 
Q 
0 
= 
Q 


i = a ali J al 
+ + 
ts < a ee Ps Ds = Cs < d, > 
+ _ 
=> Pe) Pal Ss d, - Pss 


which is the desired contradiction. 
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Under the conditions of the theorem, ites eCeSo airy 
ea vo consider trial permutations with JOO peers Jas we 
mo order. 

The partial orderings of jobs obtained through 
application of SNORE 6.3 and 6.4 can be represented in 
the form of a directed graph. Let jobs Jy sJos+ee ody be 
represented by nodes numbered 1,2,...,n and each precedence 
relation " <« " developed through application of theorems 
6.1 and 6.2 be represented by an are from node j to node i 
if i<+« j. This graph is called the DD graph and is illus- 
trated with the following example. Consider the Febeaet 


described in Table l. 





Table 1. Example Problem Data. 


Application of theorem 6.3 results in the following 


precedence relations being established. 


Ieee 2 8 3 aoaceee) 
oes a2< 4 

1<«4 Ds 

Hi oes 


tJ 
=) 
= 





Application of Theorem 6.4 establishes relation 3 <« 4. 


The DD graph for this example is illustrated in Figure 6.4 
OF EQY—OD 


Figure 6.4. Example DD Graph. 


iitS seiscon 2S Used )l Geren enteamc onal tion under 


meee there exists an optimal schedule in DD order. 


Theorem 6.5: In the DD graph, if there exists a hamiltonian 
moammmetrom node n to node 1, then there exists am Optimal 


Penecule in DD order. 


Proof: Theorems 6.3 and 6.4 develop only relations between 
Heempairs Which, whem represented graphically, are reverse 
pees, the only possible hamiltonian path constructed only 
of reverse arcs is the reverse DD sequence. 

Under the conditions of Theorem 6.5 and due to the 
transitivity of the " « " relation, the partial orderings 
of Theorems 6.3 and 6.4 impose a complete ordering on the 
SCI. oie nComalle trial permutations except 


(1,2,...,n) are eliminated from consideration. 
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For the DD graph depicted in Figure 6.4 in which 
Pub ereversowarecs are allowed; the only possible hamiltonian 
mech trom node five to node one is (5,4,3,2,1) and it is 
mental tO GCetermine if Such a path exists. in the Sections 
which follow the DD graph will be augmented with a set of 
forward arcs, and again it will be desirable to determine 
mi paere €xists one or more hamiltonian paths. The practical 
applicability of Theorem 6.5 might thus appear to be doubtful 
as there do not presently exist any efficient methods of 
specifying hamiltonian paths in arbitrary graphs, [Refs. 7 
and 18]. However, for the graph associated with this 
problem, a simple technique has been developed which 
moieties all such paths and is presented in Section VI,D,2. 

2. Due-Date Algorithm 

Under the conditions of Theorem 6.5, a problem can 
be solved very easily through application of the following 
eupcerscthm. Let 

if ee omerderted se uO ls) Ob Tica eCres srepresenvine 


1 
pee oe oneanic sdevelloped during 


Couclceratlommel “eos lye,-..,1 in the DD 
sequence. 
S(j) = the reduction im completion time of a partial 
schedule as a result of excluding doc 
Pekbec@ rs Gim : 
iteelinoe alieioos im .DD order..Sec [.~. = 4. 


0 
Scum. “GO LO Svep 2. 
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On eet eee est Op me OL herwace form nes Pow i 
GO to step 3. 
Bo See Deon oe Ete— it I anceecetlO Step 2. 
ele Jr od 
If not} go to step 4. 


Cop Uce Sen) e- min to, , mint@w 1m) | “forall 
vel. 9 ee 
ik 


V>j 


ie I... Sellcemelnicdes arcu ch thabsatk) = max oC i)” 
Boe Oe 
and remove k from I.. set i = itl and go = 


COWSUeED 2. 


icmp Voonwiac the Dbealporithm produces an opvcimal 
pemeanile rests on the facts that while iteratively building 
perecanilc ayn PD order, if an infeasible partial schedule 
is produced, only one job must be excluded to obtain feasi- 
bility, and that the rule of step 4 selects that job for 
eeclusi1on which allows the remaining partial schedule to 
Pemcempleted in minimum time. Prior to proving the opti- 
Meetoy Of the algorithm, these two facts are stated as 
Theorems and proved. 


Let C(I) be the completion time of schedule I. 


Theorem 6.6: Given that there exists an optimal schedule 


mae eorder, jf partial schedule I iS feasible, but for 


k-1l 


= TU tk}, C(I) > d., then one and only one job must 


be excluded from Ty Pe soroauce feasibi lacy : 


° AWG, 





Proof: Since I, _, is feasible and I, = I, _, U{k}, k can 


be removed from I, to produce a feasible schedule. 


k 
the usefulmess of the Theorem is in showing that at 


fee One Job must be excluded from I, to produce feasibility. 


k 


Theorem 6.7: Given that there exists an optimal schedule 


mob order and that partial schedule Toa is feasible, but 
eee = 1 {k}, c(I,.) > d,, then excluding m from I, 
where 


Cn = iebe SUG) 
tel, 


allows the remaining schedule I, - {m} to be 


k 
a) feasible 


b) have minimum completion time as compared to 


all partial schedules I. =e) I 


Rreoof: a) feasibility; 


All jobs in I, - {k} are feasibly scheduled in I 


k k 


and will remain so if any j ¢« Ths j * k is excluded, but 


for J,; C,. > dy. Clearly C(I) = C., Ci ~ dy. £ p,, and 
S(m) > P,- So, 

Ge) = OC) = sims OC) = py, = C, = Py: 
thus C(I, -{m}) < di, and I, -~ {m} is a feasible schedule. 


NAIL 





b) minimum completion time: 


k 
thus 
vs < rw e a 
wee Oe eos) or fall jin 1h 
and 
{ } < e e 
C(I, ~ {m}) = C(I, - {j}) Bones eAlEs y ayay I 
SO 
I - {m} has minimum completion time. 


DWemoeeocreunavsune DD aleorithm produces an optimal 
schedule is now presented. 

Assume the DD algorithm is applied to a problem and 
a set of jobs E is excluded. Assume also that there exists 
em@ether set of jobs F with |F| < |E| for which {1,2,...,n} 
- F is a feasible schedule, thereby indicating that solution 
{1,2,...,n} - E is non-optimal. The proof will show by 
induction that |E| < |F[ , no matter what the set F is, 
PMs  cOneracdverame the Second assumption. 

Let E, be the set of all jobs removed by the DD 


k 
Comino eouana aneluding consideration of J , i.e., 
k 


ec 





E. = fele € E and e < k} 


k 


HA 


Demitarly, let 


eae (ewc werent << 1c} 


k 


WA 


The induction begins by showing that poo K Pe 
Where k is the first iteration at which a job is required 
memwe excluded. 

imtao Coe sce Ol Lhe proolem., apply the algorithm 


Heid at iteration k, I ee ee ee ee i) 


k-1l 


is formed and C(I) SI By Theorem 6.6, one job from I 


Kea k 
moc be removed to produce feasibility. Index m is deleted 


ieom Ty where eo JOP J 


SGie= max j). 
jer, 


Hence [Ey | =e 


But since C(I) aes | there must be at least one f 


Ve 
iieeesuch thay 1 < tf < kK, or else partial schedule 


{1,2,...,k} - F, will not be feasible. Hence 


k 


esate | = 2. 


Note that if [Fy | = [Ey | = 1, then by Theorem 6.7, 


eS 





Cue eS ae FY) Penn. «4K) = E,,) 


Now Suppose at iteration t—1, Ta is feasible and 
at iteration t, I, = I,_, Witt is formed and C(I,) > d,. 
Let 
q [eee = [Pee | = an and 


c({1,2,...,t-1} eee) Sle eee, U1 bi Be). 
Two cases need be considered. 
1, dif g < G', increasing the order of E by one will 
not disturb the inequality |E, | < baal 


Aue lee = da Tove that 


Gite) SoC ene es Oe ees) 
= c({1,2,...,t-13 eee Ped, 
But 
che SC WM jecomeail): 7 ae! Py 


HWA 


CC ee eae eee an) )) ts 


SOuuMecemllou Cx St ae least one £ in F such that f is not 


in oa ee mcm owe poe ecilhse (Une partial schedule 


{ads ot t= F, is infeasible. Thus 
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|F |F 


| 2 IF,_1I 


waren implies that 


gh ae a Deis Peers cet ly. 


t! 2 IE 


With this, the induction is complete and the 
Peneradiction to the assumption that |F| < |E| is evident. 

the DD algorithm provides optimal schedules for 
problems with due-dates and non-zero release times and is 
thus a direct extension of the work of Jackson and Moore, 
[40], £32]. For the problem with gee oe sores ata, 
Jackson's lemma reduces the problem to consideration of 
only the DD trial permutation, and Moore's algorithm 
eeereientiy extracts the optimal subpermutation. It is 
maeeresving to note that the algorithm of this section 
moonces identically to Moore s if r, = 0, for i = 1,...,n. 
This can be seen by noting 1G G2 ome ake ree Omeor ail 2. then 
we) = DP, for all j and the exclusion rule of step 4 reduces 
To selecting for exclusion from the infeasible partial 
Pence iWwienausUme current ateravion thay job with the longest 
mpmeocessing time, 1.e., Das | Pa» Whichems the identical 
rule used by Moore. A 
C. RELEASE-TIME SEQUENCES 

Chem MC wOt medias Scepmom lies in the fact that there 


exists a theory relevant to R sequences which parallels 
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meee tor DD sequences. As in the case of DD sequences, it 
is sometimes possible to determine that there exists an 
eeewmat schedule in R order. The theorems giving the condi- 
memes Under When this 1s have nearly identical statement 
and proof as tumose of Section VI,B exeept that jobs are 
indexed differentiv. When there exists an optimal sequence 
Mmemamcrcden., ae@ain tf 1s necessary only to consider a single 
mem! permutation from among the n! possible. Section VI,C,1l 
presents conditions under which there exists an optimal 
aemeaule in R order. In Section VI,C,2 a simple aigorithm 
aus presented which extracts the optimal subpermutation 
imeem che R trial permutation. 
ieeerartiat R Orderines 

isles -slavonipgu alg! eroferee wteia\ VI,B,l1, pairwise eenparisens 
of job parameters can be employed to eliminate from consid- 
Sauron certain trial permutations. Theorems 6.8, 6.9, 
and 6.10 present conditions under which all but the R trial 
permutation can be eliminated from consideration. 

Let jobs be indexed in R order. Theorem 6.8, as 
does 6.3, eliminates trial permutations from consideration 


eewouch Comparison of adjacent jobs in any optimal schedule. 


Theorem 6.8: For every pair of jobs Js and Jean with 


d, < de4y> if there exists an optimal schedule in which 
Pe ie bien Chere EXiSts aise an optimal schedule in 


Wikila@iied <9 92h 1. 


ele 





Pie speceou simethis (case 1s tdenvical in statement 
to the proof of Theorem 6.3, given the revised indexing 
eroaceaure, and thus will be omitted. 

Under the conditions of Theorem 6.8, it is unnecessary 


Mereconsider any trial permutation in which it+l preceeds i. 


fmemma 6.8.1: If the DD trial permutation is identical to 
the R trial permutation, there exists an optimal schedule 


in R order. 


Proof: In this case, Theorem 6.8 imposes a complete 
Peeters On the job Set, 1.¢6¢., there exists a hamiltonian 
mam trem node nm to node 1 in the graphical representation, 
and by Theorem 6.5, there exists an optimal path in DD 
eeeer., which is the same as the R order. 

It is interesting to note that Lemma 6.8.1 gives ; 
eondition under which there exists an optimal schedule in 
both R and DD order which is independent of job processin 
eee Si. 

The following theorem is similar to Theorem 6.4 in 
that it eliminates trial permutations through comparison of 


30D parameters for arbitrary pairs of jobs. 


Theorem 6.9: For all jobs J, and J. NGL L! aL SAI Gls ds 


and Ds a P, > d. - Bae Micke mewmlclu scene OOUlmal schedule 


Contatnane bouh Js and Js WY gt] oo ene 


bea (a 





Culcoemacainmeeme=ostavemene Of Une proot is identical 
to that for Theorem 6.4, given the new indexing procedure, 
Em@emenus will be omitted. The usefulness of this theorem 
is that when considering trial permutations in search for 
eme which contains an optimal subpermutation, it is only 
necessary to consider those in which i + j. 

Theorems 6.4 and 6.9 are nearly identical in state- 
ment and proof and differ mainly in the method of indexing 
used. In order to illustrate the difference, a graphical 
comparison is made. In Figure 6.5 jobs are indexed in R 


order and d, - r, of Theorem 6.9 is shown. In Figure 6.6 


J 


| 


J) IF 
es 


Figure 6.5. Illustration of Theorem 6.9 


Figure 6.6. Illustration of Theorem 6.4 
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jobs are indexed in DD order anal d. - Ps of Theorem 6.4 
55 illustrated. These quantities are clearly different and 
only accidentally bear the same name due to the method of 
indexing used. 

| As in the DD case, it is possible to represent the 
Sereial orderings developed through application Of sUheocens 
6.8 and 6.9 graphically. Let nodes be numbered in R order 
and let arcs be defined as in Section Vip, ls. this Geegiical 
representation can be vsed to state a condition under which 


there exists an optimal schedule in R Order. 


Theorem 6.10: In the R graphical representation, if there 
exists a hamiltonian path from node n to node i) them enere 
exists an optimal schedule in R order. 

The proof is identical to the proof of Theorem 6.5. 

2. Release-Time Algorithm. 

Under the conditions of Theorem 6.10, it is only 
necessary to consider the R trial permutation in the search 
for an optimal schedule. The following algorithn, which 
Eeploits this fact, is an inverted form of the due-date 
algorithm of Section Ve ac ae e ce be an ordered set of 
Mow. indices representing a partial schedule developed by 
considering jobs i, itl,...,n in R order. Let W(1) be 
the start time of set I, and S(j) be the increase in start 
time of the partial schedule if J; ise ce HUGeds 

ec sinerecrders set 1 = (O. 


Set i =n. Go to step ed. 
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2. If i = 0, stop. Otherwise form I7 = 1***\ Jia}. 


COnue Suep 5. 


Bee COoMpuGe WCE) ee minfW(T'-) - Py, d, - p,d. 


if mie) 1G See | Ano gon von Ss uep c . 


ay 
Otherwise, go to step 4. 
We eCOMpuve ol jj) = mintp.. min Cd. - Cd COV melee 
SLSR A a 
in Tee Select index m such that S(m) = max S(j) 
ete 
i ne 7 
and remove m.from I”. Set W(I7) = W(I) + Pat 


[ey i = 1-1 ane weo Go step 2. 


ie pvooteenay the algorithm will produce an optimal 
Semeaule is siamplified by first establishing two facts; 
first that while iteratively building partial schedules, 
mma inieasible partial schedule is developed, at most 
Saiemaop meea be E€xcludéd to produce feasibility, and secor - 
that the exclusion rule of step 4 excludes that job which 
eeepems the remaining partial schedule to have the latest 
possible completion time. These facts are stated as 


theorems and proved. 


Theorem 6.11: Given that there exists an optimal schedule 


in R order, if partial schedule I**! is feasible and 


toe Tecue \G) ic} is not feasible because w,< r,, then one 


and only one job must be removed from Te to produce 


Hees tDiLlicy. 
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P@Or: Since ii is infeasible, at least one job must be 


removed to produce feasibility. Set ts is feasible and 


rx = co (eee so k can be removed from i to produce a 


feasible schedule. 


Theorem 6.12: Given that there exists an optimal schedule 


in R order and that partial schedule oe is feasible but 


oe Kt 


I (Jik} is not feasible because W, < r,, i.e., 


k k? 


aT) <7 then excluding m from es where 


lez 


Stn) = max SCJ) 
eek 
ae 
allows the remaining schedule ge {m} to be 
a) feasible 
b) have latest start time as compared to all 


Pewmtials schedules a “ppt Oreo. 7 an i 


Ee@ot: a) feasibility. 


k+] k 


All jobs in I are feasibly scheduled in I and 


we remain so if any job j in ea ieee see xc luded. but 


ce 
toae Jy? W, < r,- Clearly W(I) = W, andr, -W, § P,, 
and S(m) 2 Py: 
W(I* - {m}) = w(I*) + S(m) 2 w(I*) 4 Die PR: 


Dus 


isl 





r, < W Se 2 fay, 


we SR ee 


so schedule rk - {m} is feasible. 


pyetia rec ues tect ime. 


(GO = max S(4) 


yeies 
thus 
k k ; : k 
Ce yeeeetcan) > WO TC) one aerials dl 
and 
wr = inl) 2 wrk = ty foreaiel j an ies 
SO 


2 =e etdsevne leaves. Possible start time. 


iiemoROo mer nay tie algorithm produces an optimal 
schedule is now presented. Assume the R algorithm is 
epplied to a problem and a set of jobs E is excluded. 
Assume also that there exists another set of jobs F with 
[F| < |B] for which {1,2,...,n} - F is a feasible schedule, 
thereby demonstrating {1,2,...,n} - E to be non-optimal. 
The proof will show by induction that |F| > |E|, thereby 


Coumuagterane the second assumption. 


ipp2 





Let Ey be the set of all jobs excluded by the 


algorithm down to and ime iuudinecomsicderarson of Jy aera 


meverse R order, i1.é., 


By felle « BH and e = k}- 


SmmelLarly, let 


Fee len pep sect 2 ki. 


k 


lv 


The induction begins by showing that |E, | ae 
where k is the first iteration where some job must be 
excluded from a partial schedule. 

Apply the R algorithm to the job set for the problem 
Mer cor some x, 1°*" is feasibie, F =r" \J{x} is 
formed and me aes By Theorem 6.11, only one job must 
be excluded to produce feasibility. At step 4 J is 


selected for exclusion where 


S(m) = max S(4), 
ces 


and thus [EL | =e Oce muna cs tince wert) > r, there must 
be at least one f in F such that k < f <n, or else 


{k,...,n} - F, will not be feasible. Hence 


k 


fyi so |e 


«| kl 


‘Ss 





Note that, by Theorem 6.12, if IF ae then 


a 
W({k,..-.n} - E,) 2 W({k,...,n} - Fy). 
. f ‘Bag aeee : 
Now suppose at iteration n - Ut, it is feasible 


+ 
peat iteration n - t + l, 1’ = 1 Lyte} is vormmecdrand 


nee” ) Signe Let 
a = Well Solera scl cae 
WCUewrL 6 66 cial ten) iC Gc area ob sie De eye 


Two cases need be considered. 
1. If q < q', then placing one more VoOpetag@exs an 


ia 


E will not disturb the inequality |E,| < alle 


Paced a enove vaae 


wl) = WCit,..-,n} - E,,,) 


SW laser E <ot 


t+) 7 Pe t? 


but 


il GCSE yes) e irae Fiay? - Py 


9 Civ oer oe Ey 44? Ns See 


so there must be at least one f in F such that t < ie tS el 


— 
= 


and f is not in F,,, or else partial schedule {t,...,n} - Fy 
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will not be feasible. Thus 


i} 


(Bile (egret ais aac] 


which implies that 


The induction is now complete and the contradiction 


to the assumption that |F| < |E| is apparent. 


D. GENERAL SEQUENCES 

Sections B and C present two conditions under which 
all trial permutations except one can be eliminated from 
consideration. In Section VI,D,l it is shown that the 
preceeding theory can be integrated to obtain, in certain 
instances, trial permutations which are Known to contain 
optimal subpermutations which are in neither R nor DD order. 
Section VI,D,2 discusses the case where it is not possible 
GO Praiée the set of candidate trial permutations to a 
single permutation. 

1. Special Cases. 

Given a job set, if neither the DD nor R graphical 
representation contains a hamiltonian path from node n to 
Mode weap soU lit may be possible to reduce the problem to 
consideration of a single trial permutation. Theorems 6.4 


and 6.9 develop precedence relations between arbitrary pairs 


ae, 





of jobs which are independent of method of indexing used. 
fais, vhe sev of all relations developed by these two 
theorems can be coupled with either those developed by 
Theorem 6.3 or 6.8 to form a consistent and valid set of 
relations on the prop Lem. 

Let the ADD graph be the DD graph augmented with 
all arcs developed through application of Theorem 6.9 and 
the AR graph be the R graph augmented with Al legaecs 


developed through application of Theorem 6.4. 


Theorem 6.13: If in either the ADD or the AR graph there 
exists a hamiltonian path, then there exists an optimal 
schedule whose order ie “Sspecus L6G spy the reverse order of 


the hamiltonian path. 


Proof: The arcs in the hamiltonian path represent a set e> 
n-l precedence relations which impose 4 complete ordering 
on the job set and thus all trial permutations other than 
the hamiltonian path, in reverse euscleig yy eels, eliminated 


from consideration. 


As the starting and ending nodes of such paths are 
not necessarily nodes 1 and n, visualizing such paths is 
Simp iiaed Dy augmenting the graph with dummy source node 
s and sink node t and with arcs (i,s) for all nodes 1 with 
§* (i) = 0 ana (t,j) for all nodes j such that 


6" (35) 


ii 


+ 
eras Ge ee ee 1 WREDS a) is the positive 
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degree of node i and 6 (i) is the negative. A hamiltonian 
mao in the original graph is a hamiltonian path from node t 
to node s in the new graph. 

If the set of candidate trial permutations iS 
reduced to a single one, the problem reduces to excluding 
the minimum number of jlObmanaceeces) 1 LOm that permutation 
required to preauce Aoeetca) oe albatie n/p ee duels optimal subpermutation 
5s obtained by indexing all jobs in order Re in cera tes SIG) = 
(1, s455-+-s4,) 4s the sole candidate trial permutation and 
applying either the DD or the R algorithm. 

2, Combinatorial Accelerations. 

fet 2 pesche seu ot all trial permutations which 
are not eliminated by one of the theorems of Sections II 
eat, if there does not exist a hamiltonian jorenulate alld 
either the ADD or the AR graph, then (Zee and. cach 
element of Z could contain the optimal schedule and there- 
fore must be explicitly or impliel uly investigated in any 
search for an optimal scheqaute.) lhe combinatorial nature 
of such problems suggests that combinatorial programming 
fPeecmniques be applied. In combinatorial approaches such 
as implicit enumeration, branch and bound, and dynamic 
programming, the set of feasible solutions is implicitly 
enumerated in an orderly fashion by constructing pant lal 
schedules and attaching a value to each partial schedule 
consistent with the jope ole detesie objective. Any such technique 
can be greatly accelerated by utilizing the information 
Gennes sn the development of the ADD and AR graphs as 


demonstrated in the following sections. 


AS i 












Fie OOM Manges - 
Given trial permutations 7 * (Ty sTooes 9M) SNe 


let m(j) be the set of all positions held by fee ers 


nm(j) = EN ha 2a yaa Sits 
Let 
n_(j) = min i and n (j) = max 1 
e é Q 
ie TGs ie (Jj 


Let (m(5) sm) (5) be called the range of J, ieee ear Ly 
pay vrial permutation Te cheeoe mien Li) Some overs ah Zalbeygl) au 
such that m CJ) pees m (35) need not be considered in any 
search for an optimal sequence. These range boundaries are 
Smmediately available from the graphical representation. 
For each node j of the ae let TA) 5; evan and 

tie le Pesci). This is seen throveh consideration 


of the example graph in Figure Gare 


| 


Figure 6.7 Example Chayone\ 
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Note that there are no jobs which must preceed either Jy 
On Jo pecause there are no arcs which are positively inci= 
dent with node 1 or node 2. Thus 7 (1) a sec ee ee a 
and similarly (2) Zila Note also aaay Jy must preceed 
Jy and Je sn all elements of Z, hence 1 ean hold no position 
greater than m (1) =o oo 8 (by & TS Sabeteba a 
m, (2) eo eee ius) bc anes for J, is Gils) 
and for J, is (1,2). The ranges for jobs J25 Jy» J and 
Je can be computed to be Arcs (Assit CE EIS» ual! (5. 6») 
respectively. 

Combinatorial approaches can be accelerated 
py exploiting the job ranges developed to reduce Che numees 
of partial and complete schedules which need be evaluated. 
For the example graph, Mateo Opeeued ocean y constructed 
from the job ranges computed and lists all jobs which could 


occupy each position in a trial permutation contained in 7 





Dost Lode ges al 2 3 4 5 6 

candidate 1 a al al 4 6 

jobs for 2 2 3 \ 5 

BOS eso. + 3 e, 5 6 
Table 6.2 


Table 6.2 provides any algorithm which builds 
and extends partial schedules with a greatly reduced set 


of jobs which are eligible for use in extending whatever 


So 


-a& 6 





current partial schedule 4s being considered. In are 


example, for instance, sf a partial schedule of length two 
is being considered, then at most two jobs can be usec to 
extend the current scnedule, end pernans jusc one. Witnout 


the table, as many as four need be investigated. 
>. Complete Specification Om Ze 
Tt is possible to use the informetion conteined 
in the table of the preceCans seeewenmeto isc ecen trae l 
permutation contained in 2. When |Z| is small, then total 


enumeration over _ USane en efficient algorithm sucn @4s Tne 
Lm ] S 


of Section Il may compare favo 


ry 
Wy 
cy 
} 
= 
< 
ct 
Me | 
Wy) 
ve} 
ect 
QO 
O 
oe 
} i} 
a 
mw 
cf 
O 
by 
Je 
0 
} 5 | 


method available. 


All elements of Z can be Silustreted graphically 


Iameconstructimg a branching tree with nti levels as foilows. 
Consider Figure 6.8 which is the tree constructed from 
Table 6.2. At level zerc, creave node zero. From noce 


meme pDrancn to level 1 to nem node i where j is jissed sn 


v 


eomumn 1 of the table. From each noe 


) 

i) 

cf 
t— 
(D 

<j 

Dp 

| 
} = | 
Ne 

ue 
ys 

a) 

* 

fo) 

ry 


table and k is not in che current! path. This process is 


@entinued umeil level n is complete. The elements of Z 
are those branches econteinins tit1 nod@es. Note tnhav every 


he tree is a subpermuvetion of some elemert oO 


cr 


branch in 
De 


There exists an aivernate MEcnCa O 


each element of the set Z és a ham 


}4 
ct 
O 
=: 
: 
1S, 
) 
ct 
we 
by 
SS 
O 
> 4 
") 
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level 0O 


level 1 


level 2 


level 3 


level 4 


level 5 


level 6 





Figure 6.8 


Gummy source node s to a dummy sink node t in a graph 
Gemuatienietemoges 1,2,...,m constructed as follows. Include 
all ares (j,i) with i < j included in the complement to the 
DD graph and all ares (1,j) with i < j, except arcs 


Cm were eestieh that there exists a path (k,j,i1) in the 
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DD graph. Include an arc (s,i) for each node i such that 
5*(4) 
oa) 


fees Hhamlitonian paths from s to t, and, in fact, the 


QO and an arc (j,t) for each node j such that 


Ve vice reslltangupragn Contains 21) elements of 


elements in Z are the only hamiltonian paths in the graph. 
Figure 6.9 shows this graph for the DD graph given in 


Figure 6.7. This approach to the determination of all 


OOD) OO) 9 © 


Figure 6.9 Graph Containing Elements of Z 


emements of 24 adoes not at present appear to be practical 
Some to the lack of efficient methods for specifying 
heme lbOntan paths in arbitrary graphs and also due to the 
Seese Wivui wWeaich these elements are determined through 
construction of the tree shown in Figure 6.8. 

The tree illustrated in Figure 6.8 displays 
perio mnlvat bom wheem COUuLG contain an optimal 
solution, and therefore could be used to determine all 


alternate optima. 
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iiven y sonesOpeimalesoluvion is* desired, the 
entire tree need not be constructed. Application of the 
mewnedology of branch and bound can greatly reduce the 
number of nodes which must be created in the tree by com- 
Peeine a2 bound for each newly created node. This bound 
represents a lower bound on the number of jobs which must 
be excluded if jobs must be processed in the order speci- 
fied by order in which node labels appear in the branch. 
For example, consider the partial branch (0,1,3) in Figure 
6.8, representing all permutations starting with elements 
1 and 3. Through consideration of Table 6.2 only, a bound 
euumone Can be associated with the node labelled 3 in this 
Pieeaneh since Jo TomeOuUllIcCLUIG@ecmeld miurilS KMIOWnM uhal 1ndex 
mapeannos hold any position in a trial permutation greater 
than two. In general, bounds can be computed on each 
Povevecreaved medae by indexing Jobs according to the order 
eaeewlhitch they appear in the associated branch and applying 
mace UD aleorithm. - Obviously it is best to pursue tnat 
Meaich currenviy having the minimum bound. 
3. Remarks 

MmetemecceioOn Provides a theoretical basis for the 
Sovevopiciowotechiicieny Solution methods for problems with 
Menace qemu vom piirte Tes atid, where possibie, presents 
efficient algorithms. This completes the presentation of 
researc results pertaining to the problem stated in Section 
TI(B). In the following chapter, generalizations of the 


Pacer comeOnotdered and uneir applicability noted. 
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Avenues for future research on related problems which 


pebear FO be particularly promising are suggested 


44 


Vili SoENERADLZATLONS 


A. INTRODUCTION 

This section contains a discussion of several problems 
which are not central to the main theme of the research 
fepoercted here but represent promising avenues for future 
research in Investigation Theory. In each case, the problem 
of Section 11,B is directly extended and the results obtained 
tere pia problem which are applicable to the extension are 
eemmariazead, along with additional facts which are immediately 
apparent upon SOG Ent ion On speera | Drobo Lem structure. 
In some cases these results suggest solution methods which 


are noted. 


mee LHe VALUE PROBLEM 

The objective "minimize the number of targets to esca @ 
uninvestigated" implies that all targets are of equal wor h 
Daevalue. im many formulations this is appropriate, but on 
meners it 15 mop. Yor example, in the Market-Ctime problem 
@eseussed im Section £1, a large ship appears to be of greater 
Zac vOmunec mt nNVeSGleabor tian a small one in that it can 
Carry a greater amount of supplies. 

A direct generalization of problem (2-1) is obtained 
through changing the objective to maximization of the value 
of targets investigated. For problems whose solutions are 
known to have a specified ordering, this generalization has 


been shown to be solvable in Section III,B,6 using dynamic 
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Peeercannine. Hor other problems the general algorithm of 
Pecvlon £V,C,3 can be modified to handle this objective by 
feouima the bound associaved With each node in the tree be 
Piemoume or vhne values of targets lost rather than the number 
est . 

Pato ne hb Eviar aunere toeoUulty ecient structure in this 
Sven aton to allow development of solution methods even more 
Peoeectenu. tNnan GynamLe programming. it is also felt that 
Bae searcn for such techniques should begin through consid- 
eration of the following job-shop formulation which is 
“eed the value problem. 

iE voDvemeot acement 

Consider the job—sShop scheduling problem with one 
Machine and n jobs, Gach with processing time Py» dGue-date 
d, > and value Me POG SiC Loe Drecessed Prior to Lts 
eave inva lnew1 Ss tTealized. ff mot, zero value is 
meaiez7ea.) Determine the schedule with maximum value. 

2 eUiMary eOnenesules Applicable to the Value Problem 

Jackson's lemma [Ref. 40] applies to this problem 
aoa tneretore only solutions in non-decreasing order of 
eile -davessaced be considered. This is verified by noting 
Phabteeivenweny Optamal solution not in due-date order, the 
same jobs can be rearranged in due-date order producing a 
feasible schedule containing the same jobs. In the following 
daseuso One OOS are assumed to be indexed in due-date order. 
ao steeounrnc Jenna, the following inveger 


Proecamnimaestormulation of the problem is possible. Let 
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xX; = Pte) OOM LG ueOmealmed anechne schedule , and xX, = 0 
fmmerwise. The problem is to determine Xs ie Meee cece 2 05Ta 
@reacr to 


i=n 
maximize : Vix 
j=] 
jri 
subject to y 2), Or ae @ bp —1 
J hl Ps 5 ae 4 (7 1) 


This formulation suggests that Moore's approach 
{Ref. 32] may be appropriate. In such an approach excluded 
Memos are not considered for reentry into the schedule. 
Moesiening different values to different jobs makes such a 
method incorrect in that jobs once excluded by such a pro- 
Gedure need be considered for reentry when further 
Mmemeasibilities are encountered. 

The temma reduces the problem to one of excluding 
jobs from the schedule (1,2,...,n) in,order to maximize the 
value of the remaining jobs. The number of subpermutations 
of (1,2,...,n) which need be considered can be reduced by 
taking advantage of the following observations. 

aaeeee lea be whe Gardiness of job i in some schedule. 


a 


Let T = max qT, mmocmeamle s(t 2....,0 i. All jobs Js; 
J 


ein omconvcimica sim allsoovilal solutions. This 


fact is seen by noting that once the tardiness in the 
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eemeaule Up to and including job se Home eC pdhed. alli 
subsequent jobs can be feasibly scheduled. 

eee eset ec ejes hep Sit Vv; < Le and Ps > PD,» 
mem where C€xists no optimal schedule including J, and 
ome Luding Dai This fact is verified by assuming T° is an 
OD eee schedule containing Js and not aie and showing that 
schedule nt which corresponds to T° except that it contains 
J, and not J. is feasible and has greater value. This fact 


eiinaves trom consideration all subpermutations containing 


mead not j. Obviously, if there exists a job J Suen tna 


ve > max Vv; and Dn < min D.> 
at zl 
then uae Pome oOMuormmed Jn alt optimal schedules. 
C. ommilarly, if Tt. Sst Ores =) Lae eK and 


qT. mo omg euinere yexXists a job ke with 1 <m < k such tnat 


Vie ney) Vis and p_ > max ole 
SL et ee me ees a 
ifm ifm 


micme tnere E€XiStS mo Optimal schedule containing ae 


Ge ome Gem e mist S (2/3 OD ae WS tl Seg eib ie) al Mac lelicne 


ened Since da 2 Pn ices e comodo dmal scneaqule contain ne 


Jee This fact can be extended as follows. Let I be a set 
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emeoos Known to be included in all optimal schedules. If 


there exists a job J, such that 1<uc<n,u g I and 


Wie > 2 V, 

iglI 

ifu 
and IU{u} in due-date order represents a feasible schedule, 
then Jy itmeOmuciied inecalilOopuimal SolLuclons. 

Doe Ooo mole SOoluLion Mevnods 
Unger certain clreumstances, obtaining optimal 

Teer Ons 15 trivial. Kor éxample, if the due-cate order 
corresponds to a en inCreate processing time order and 
to a non-decreasing value order, then excluding jobs from 
mae schedule (1,2,...,n) starting with Jas then Jos Gb Cun 
until feasibility is attained will produce an optimal sched- 
ule. This is because such exclusions take the job scheduied 
teeen che largest processing time and smallest value and 
remove it from a position which reduces the completion time 


om all remaining jobs. 


PNOtMere Graviglecase 1S seen by letting im be the 


maximum taraginess in the schedule (1,...,n) up to and 

Ane Luding Dae Oe Jy > tT, is known to be zero or else Jy 
7 

iS initially removed from the problem, hence T = 0 also. 


Let 45 be such that 


i, = min {j|T’ > oO}, 
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and 


i, = min {jim > 0, 3 4 tha the 
ete. The sequence (1, ,1,,---,4,) represents the places in 
the schedule (1,...,n) where maximum tardiness increases. 


Maen, if 


then the optimal schedule contains job indices 
ie sijte,--..ni anduatooua Viemietemingices ) for which Y 


Peuals one in the following knapsack problem. 


Le 


maximize 


He Os 
home 
{4 
< 
C4. 
pS 
Cy» 


subject to ce (7-2 


C4. 
UO ts i 
| 
©) 
Co. 
O< 
Cy 
+4 
fe 


iimOne a dcromen soeech1On Vil .B.2 sipnificantly reduce 
wi worectmomeule Sel Of feasible solutions, then an implicit 
enumeration over the reduced set appears to be an approach 
which would compare favorably with the dynamic programming 
So Memon me cules Lt.  hirther reductions in the order of 
Uicmuless ble SOluUbIOm set may be possible. This is an 


Seeemomoteovea Or T1ubure research. 
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C. PROBLEMS WITH MORE THAN ONE INVESTIGATOR 

iimcosarsservaurom deals mainly with investigation 
problems in which there is a single investigator. Generali- 
zation to the case of multiple investigators was shown to be 
possible in Section III when a known ordering is externally 
mieosea On all optimal solutions. The solution method 
described is dynamic programming in which the state variable 
X is a vector with dimension mdtl where mis the number of 
Mmesvigavors and d 1s the dimension of the region. Since 
this approach is computationally impractical for even small 
fii, Gne search for practical methods seems Co be a 
moronwhile avenue for future research. 

Although the treatment of the one-machine job-shop 
weameauling problem is quite broad, generalizations to more 
than one machine are SAO. One of the only significant 
gmehnievements is that of Johnson and Jackson [Refs. 24 and 
23] for the two machine problem in which the objective is 
minimization of maximum flow time. 

Analysis of multi-investigator problems should clearly 
begin through consideration of problems with two investiga- 
wors. It 1s felt that the following scheduling problem is 
an See AE point of departure. 

Consider the n job, two machine problem in which jobs 
have processing times D; and due-dates dq. e@itee eerily 
and the objective is to maximize the number of jobs processed 


prior to their due-dates. 


lig ad 





Mrincerer brocramming Formulation 
The problem has the following integer programming 


Pormulation. Let Xn = lif Je is scheduled on machine A, 
and Xn =~UMOtherWwise. ~olmilariy for Xpe- The problem is 
J 
to determine Xn Xn5? Se eee OO 
n 
maximize 3 ae oe 


1=A,B j=l 7d 


k 
SUOMCCER TO MeNenp xX, -< G kis lui egn (7-3) 
je. J A K 
k 
ee os see k=l, nig 
j=, J BI K 
ENG + shy Ss ai es ibe gt 
ae = 0,1 i =A,B je=zAl, M9 


Ee OD LSCUcscion 
Mice i OMOowlicn Ths meueinvendeac To represent 
emeomOleve analysis of this problem, several facts appear 
worthy of mention. 


Let Ty and Tp represent schedules for machines A and 


O 


B. There exists an optimal schedule tm = ( - is 


Ue et 


being one in which In, | +|7,| is maximized, for which jobs 


oe enene 


1m Doth 7. and a are arranged in non-decreasing order of 
Cleat veo has to eam Obvious extension of Jackson's lemma 
fOr Che ene machine problem. This fact indicates that an 
approach similar to that used by Moore (Ref. 32] for the one 


Machime wproolem may De appropriate. 


De 





such an approech would iteratively schedule jobs on 
either machine until a job is encountered which cannot be 
feasibly scheduled. When this occurs in the one machine 
problem, one job must be excluded. In the two machine 
problem this is not necessarily true. It may be possible 
to rearrange the schedules on A and B such that all jobs are 
pempleted prior to their due-dates and thus no job need be 
Peeetuoed. Hach time this 18 not possible, excluding that 
aepmecurrentiy scheduled on either A or B with the longest 
processing time will produce an optimal schedule. 

The asleeomeliey fue this approach is associated with 
the method of rearranging jobs to see if all can fit. Let 
Jy be the first job which cannot be scheduled feasibly on 
either machine and let n* = cw 1) be tne wpartaal schedule 


eemeloped up to and including consideration of Jy. Rearrang- 


ing the partial schedule pote Ge ca) such that all 
jobs {1,...,k-1} are feasibly scheduled and tne completior 


time on either machine, say machine A, was minimized lead: 
to an optimal schedule since if Jy, could ever be scheduled 
meaosilbly, it ntl be appended to the end of the resulting 
schedule on machine A. 

This optimal rearrangement can be obtained through 


solving the following problen. 


Lys 





minimize hc. ober. are 
j=l J] Ea) 
4 
Subject tO Oe pene eg ele 2 ae rere al 
j=l J Aj a 
al 
ad PsXps Ss qd. ote ile Kel 
J= (7-4) 
Xn 2 XB = J] ie a »k-l 
Xa5? XB 3 = 0,1 ect leeerararaen sod Ee 


Miecmnumoeim or Varianles in (/=4) ean be reduced to 


K-1 by letting XB =] - Xn 3 and rewriting the constraints 
as 
i al 
2 Ds - a, iS a PyXq5 < d. si ae >K-1 
‘ies Jet (7-5) 
Xa ae Ore ‘es ae »k-1 


Mica nestiltancralrortuam tor the two machine problem 
Pomme Meomacheaule jobs arbitrarily uncil an infeasible 
partial schedule is developed at index k in the due-date 
sequence. Solve problem (7-4) and attempt to append Jy at 
ENeCmentdmor etme mcresimivine schedule on machine A. If it fits, 


Comune maomscicaule as before, If it will not fit, exclude 
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meee JOD Currently scheduled on either machine having longest 
Meecessing Cime. Continue to schedule as before. Each time 
am infeasible partial schedule is developed, appiy the same 
eeeelusion procedure. 

What remains to be done to make this algorithm of 
meeeercal use 1s the development of an eificient solution 
method for problem (7-4). 

The two machine problem (7-3) is easily generalized 


tom machines as follows. 


m n 
maximize 3 oy Xs 
4=1 j=l] 7 
(7-6) 
k 
SUD ye Ue © a Baas < qh aly Gt =) rear) (0 aes ecard ae an 
m 
De ver wipe ce ll ae ae sal 
fe 
sa = 0,1 alge swe Were oom Ugo. auras tl 


Contingent upon development of a solution method 
for problem (7-4) efficient enough for practical use, the 
PIrsOrivamesvaved for the two machine problem could be 


generalized to handle this problem. 


Deol Sher ROBEEMS 
Other eimterestinge problems include one in which the 
investigator can temporarily increase speed but must pay a 


price to do so, an example being use of after-burner on 


To 





Mmmeerecepvor aircrait. This problem can be translated into 
a job-shop problem with one machine, n jobs, each with 
proecessing time Py > due-date d.> and each having value Ne 
imewoperatvor has the option of running the machine at two 
reeds =BnoOria se wiiel COStSuzero GoOllars or fast, which 
werowe GdOllars per unit time. The problem is to determine 
mau schedule with maximum value. 

Paeuncr Inceresoineslormulataon is a further gpeneralization 
mene wWO machine problem discussed in Section VII,C where 
processing times differ from machine to machine, along with 
Moma ue 10r processing. None of these formulations are 


— 


considered here. 
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